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A system for high throughput foam analysis includes a foam 
generation system, an illumination source, a detection sys- 
tem and an analysis system. A foam generation system 
includes a first plurality of foaming units, each foaming unit 
including a foaming chamber and a gas induction mecha- 
nism. The illumination source provides an illumination to 
the foaming chamber of each foaming unit. The detection 
system includes a first camera configured to temporally 
record the foaming process in each foaming unit, thereby 
producing a first plurality of frames. The analysis system 
includes: at least one processor, and a memory including 
instructions for (i) obtaining a first respective frame in the 
first plurality of frames; (ii) segmenting the first respective 
frame into a first plurality of segmented images, and (iii) 
extracting, from each segmented image, one or more char- 
acteristics of the foam, thereby facilitating high throughput 
foam analysis of the first plurality of solutions. 
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obtaining a first respective frame in the first plurality of frames 


404 


segmenting the first respective frame into a first plurality of segmented images, 
each respective segmented image in the first plurality of segmented images 
representative of a corresponding foaming chamber, together with the respective 
solution and/or the foam in the corresponding foaming chamber of a respective 
foaming unit in the first plurality of foaming units 


extracting, from each segmented image in the first plurality of segmented images, 
one or more characteristics of the foam generated in the corresponding foaming 
chamber of each foaming unit in the first plurality of foaming units at the 
corresponding discrete time point, thereby facilitating high throughput foam 


analysis of the first plurality of solutions 
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duce a gas into a corresponding solution contained in a foaming chamber of | 
each respective foaming unit in a first plurality of foaming units such that the 
l corresponding solution undergoes a foaming process, thereby generating a foamin | 
| the foaming chamber of each respective foaming unit in the first plurality of 
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Tode the foaming process in the foaming chamber of each respective foaming 
! unit in the first plurality of foaming units to produce a plurality of frames, each 

i respective frame in the first plurality of frames representative of the foaming 

| process in the foaming chamber of each foaming unit in the first plurality of 

i foaming units at a corresponding discrete time point in a plurality of discrete time 
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creating a binary image from the respective frame 


selecting a plurality of contours from the binary image, each contour in the 
plurality of contours corresponding to an outline of the foaming chamber of a 
respective foaming unit in the first or second plurality of foaming units 


partitioning the respective frame in accordance with the plurality of contours, 
thereby producing the plurality of segmented images 


bape each segmented image in all of a subset of the plurality of segmented | 
‚images along a width direction of the segmented image from both sides to reduce 
‚ impact of side walls of the corresponding chamber on subsequent image analysis, 
wherein the cropping is up to 5%, 10%, 15%, 20%, 25%, or 30%. | 
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calculating a pixel value variance of each first subregion type in the plurality of 
first subregion types 


determining whether the calculated pixel value variance of each first subregion type 
in the plurality of first subregion type and cutoff values is between a first cutoff 
value and a second cutoff value, or between the second and a third cutoff value 


identifying one or more boundaries comprising: 


a solution-foam boundary between the respective solution and the foam in the 
corresponding foaming chamber at the corresponding discrete time point 


T ; 
| a foam-gas boundary between the gas and the foam in the corresponding 
] | foaming chamber at the corresponding discrete time point 


r 
| a solution-chamber boundary between the solution and the corresponding 
] | foaming chamber at the corresponding discrete time point 


determining a height of the foam in the corresponding chamber at the 
i discrete time point by counting the number of first subregion type 


from the solution-foam boundary to a top of the segmented image 


; 
i determining a height of the solution in the corresponding chamber at the i 

i corresponding discrete time point by counting the number of first subregion type | 
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determining an image gradient for the one or more corresponding grayscale images 


of the partially foamed solution 
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determining the number of directional changes for each first subregion type and 
each second subregion type in the image gradient 
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classifying the first subregion type of pixels in the one or more corresponding 
binary images of the partially foamed solution as corresponding to a solution phase 
or a foam, thereby identifying the location of a solution phase and a foam phase of 
the first material contained within the first chamber 


determining a height of the foam in the corresponding chamber at the 
corresponding discrete time point by counting the number of first subregion type 
corresponding to the foam phase 
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determining a height of the solution in the corresponding chamber at the i 
i corresponding discrete time point by counting the number of first subregion type | 
i corresponding to the solution phase i 


calculating a pixel value variance of each first subregion type in the plurality of 
first subregion type 


generating a graphic with the calculated pixel value variances as a function of the 
first subregion types of the segmented image 
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graphically determining a height of the foam and/or a height of the solution at the 


corresponding discrete time point, using one or more of first, second and third 
cutoff values 
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eas each segmented image in all or a subset of the plurality of segmented | 
‚images along a height direction of the segmented image to remove pixels below the or T 
i solution-foam boundary and/or above the foam-gas boundary, thereby producing a l 
| foam regional image | 
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i optional ly or additionally, removing noises from the foam regional image or from an 
the grayscale foam regional image | 


creating a binary foam regional image from the foam regional image or from the 


grayscale foam regional image, wherein the binary foam regional image comprises 124 
a plurality of blobs, each blob in the plurality of blobs comprises one or more 
pixels, and each pixel in the one or more pixels of each blob has a first pixel value 
obtain center coordinates of each blob in the plurality of blobs or in a subset of the 726 
plurality of blobs 
determining a peripheral boundary of each blob in the plarality of blobs or in the 728 
subset of the plurality of blobs 

i calculating a distance of each pixel in the binary foam regional image to its oe 


nearest pixel that has a second pixel value, thereby producing a distance 
l transformed image 


| using the obtained center coordinates of each blob in the plurality of blobs or in 

the subset of the plurality of blobs as a starting point to watershed the distance 728-2 
transformed image, thereby producing a plurality of watershed regions, 

i wherein each watershed region in the plurality of watershed regions has a 

i boundary 
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| assigning the boundaries of the plurality of watershed regions as ridges of the 728-3 
plurality of watershed regions 
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generating a blob segmentation image in accordance with the determined peripheral 


boundary of each blob in the plurality of blobs or in the subset of the plurality of 


i determining whether two adjacent blobs in the blob segmentation image are 
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‘merging the two adjacent blobs into a combined blob, if it is determined that 
the two adjacent blobs in the blob segmentation image are overlapped 
i 


for one or each respective blob in the blob segmentation image or in the modified 
blob segmentation image, calculating one or more of the following: 

an area A surrounded by the peripheral boundary of the one or each respective 
blob; 

an equivalent diameter of the one or each respective blob using a formula of 
sqrt (4xA/m) ; 

a perimeter C of the peripheral boundary of the one or each respective blob; 

a circularity of the one or each respective blob using a formula of 4 xm “A/C? 

a solidity of the one or each respective blob using a formula of 4/HA, wherein 
HA stands for a convex bull area; 

a first aspect ratio of the one or each respective blob using a formula of 
min(al, bl) / max(al, bl), wherein al and bl stand for width and 
height of a bounding rectangle, respectively; 

a second aspect ratio of the one or each respective blob using a formula of 
min(a2, b2) /max(a2, b2), wherein a2 and b2 stand for width and 
height of a minimum bounding rectangle, respectively; 

a third aspect ratio of the one or each respective blob using a formula of 
min(a3, b3) / max(a3, 63), wherein a3 and b3 stand for lengths of two 
axes of a fitted ellipse, respectively; 

a first extent of the one or each respective blob using a formula of 4/BRA, 
wherein BRA stands for an area of a bounding rectangle; 

a second extent of the one or each respective blob using a formula of 4/ 
mBRA, wherein mBRA stands for an area of a minimum bounding 
rectangle; 

a third extent of the one or each respective blob using a formula of A/mBCA , 
wherein mBCA stands for an area of a minimum bounding circle; and 

a fourth extent of the one or each respective blob using a formula of 4/EA, 
wherein E4 stands for an area of a fitted ellipse. 
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= each blob in the plurality of blobs 


| determining whether a size of a respective blob in the plurality of blobs is : 4+~ 736-1 
| smaller than a minimum blob size representative of a minimum bubble size 


discador the respective blob if it is determined that its size is smaller than the | r ~ 736-2 


‚minimum blob size 
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producing a subset of blobs, wherein each blob in the subset of blobs has the size 
equal to or larger than the minimum blob size 
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eroding the binary foam regional image to obtain center coordinates of each blob in 
ps subset of blobs 
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j determi whether the size of a respective shrunken blob in the subset of rr 740-2 


| blobs is smaller than the minimum blob size 


. Bd. . . . ` | 
i recording a position of the respective shrunken blob as its center coordinates, if |_|~ 740-3 
it is determined that the size of the respective shrunken blob in the subset of 


blobs is smaller than a minimum blob size 


i repeating the shrinking, determining and the recording steps, until none of the 
i shrunken blobs in the subset of blobs has the size exceeding the minimum size. 
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using a distance transformation to locate a plurality of local maxima 


designating the plurality of local maxima as the center coordinates of the plurality 
of blobs 
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i introducing a gas into a corresponding solution contained in a foaming chamber o 
i each respective foaming unit in a second plurality of foaming units such that the i 
| corresponding solution undergoes a foaming process, thereby generating a foam in l 
i the foaming chamber of each respective foaming unit in the second plurality of l 
| foaming units 
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i recording the foaming process in the foaming chamber of each respective foaming i 
‚unit in the second plurality of foaming units to produce a second plurality of ! 
i frames, each respective frame in the second plurality of frames representative of the ! 
i foaming process in the foaming chamber of each foaming unit in the second i 
l plurality of foaming units at a corresponding discrete time point in the plurality of l 
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i segmenting the second respective frame into a second plurality of segmented i 
i images, each respective segmented image in the second plurality of segmented i 
i images representative of a corresponding foaming chamber, together with the ! 
t respective solution and/or the foam in the corresponding foaming chamber of a l 
i respective foaming unit in the second plurality of foaming units at the ! 
| corresponding discrete time point ! 


| extracting, from each segmented image in the second plurality of segmented 
‚images, one or more characteristics of the foam generated in the corresponding ! 
! foaming chamber of each foaming unit in the second plurality of foaming units at | 
| the corresponding discrete time point, thereby facilitating high throughput foam 
analysis of the second plurality of solutions 
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clustering the blobs in the blob segmentation image or in the modified blob 
segmentation image into two or more clusters 


selecting a first cluster that has a larger or a largest number of blobs from the two 
or more clusters 


comparing the blobs in the first cluster with the bubbles in the foam to identify one 


or more bubble blobs, and/or one or more non-bubble blobs, herein each bubble 
blob in the one or more bubble blobs corresponds to a bubble in the foam, and each 
non-bubble blob in the one or more non-bubble blobs has no corresponding bubble 
in the foam 


deriving, using the training set, a bubble model to classify blobs in accordance with 
the one or more extracted properties of bubbles 


r 
i updating the training set and/or refining the bubble model 
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classifying the blobs in the blob segmentation image, the blobs in the modified blob 
segmentation image, or the blobs in a first cluster that has a larger or a largest 
number of blobs among the two or more clusters, into bubble blobs and non-bubble 
blobs, by one or more of the following: 
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ý 914 
generating a final set of blobs comprising each classified bubble blobs 
FIG. 9B 
916 
clustering the blobs in the blob segmentation image or in the modified blob 
segmentation image into two or more clusters 
918 


selecting a first cluster that has a larger or a largest number of blobs from the two 


or more clusters 


designating the blobs in the first cluster as a final set of blobs representative of the 


bubbles in the foam 
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i labeling the blobs in the blob segmentation image, the blobs in the modified blob 
segmentation image, or the blobs in a first cluster that has a larger or a largest | 
| 
| 


number of blobs among the two or more clusters 


modified blob segmentation image, or the blubs in a first cluster that has a larger or 
i a largest number of blobs among the two or more clusters l 


generating one or more data files, each data file in the one or more data files 
comprising one or more of the following: 


the extracted one or more characteristics of the foam in the foaming 
chamber of one or each respective foaming unit in the first and/ 
second plurality of foaming units; 

the final set of blobs; 


images with labeled blobs and/or drawn contours; and 


the first and/or second set of frames, wherein at least one frame of the first 


or second set of frames has labeled blobs and/or drawn contours 


FIG. 9D 
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SYSTEMS AND METHODS FOR HIGH 
THROUGHPUT FOAM ANALYSIS 


CROSS REFERENCE TO RELATED 
APPLICATIONS 


[0001] This application claims priority to U.S. Provisional 
Application No. 62/560,096, entitled “Systems and Methods 
for High Throughput Foam Analysis,” filed Sep. 18, 2017, 
which is hereby incorporated by reference. 


TECHNICAL FIELD 


[0002] The invention is directed to systems and methods 
for foam analysis, and more particularly, for non-invasive 
methods for foam analysis based on imaging. 


BACKGROUND 


[0003] Foams have a wide variety of applications across 
many industries. There is a constant interest for discovering 
and testing new foaming materials (e.g., foaming agents), 
both liquid and solid, as well as controlling quality or 
studying properties of known foaming products and mate- 
rials. There is a demand of non-invasive systems and meth- 
ods for studying foams and foaming processes in a repro- 
ducible and precise manner. 

[0004] As an example, foaming is an important aspect of 
food engineering, and essential for producing many con- 
sumable food products. Characteristics of foaming (e.g., a 
height of a foam, bubble sizes, bubble shapes, a bubble 
solidity, etc.) and foaming stability are among the properties 
of interest when considering new compositions for possible 
use as food ingredients. Current food development methods 
fail to make use of satisfactory ways for efficiently analyzing 
foaming properties of a vast array of compositions in food 
and plants. 

[0005] Therefore, there is a need for systems and methods 
for foam analysis that are non-invasive, reproducible and 
provide precise results efficiently for a large amount of test 
entities. Such high throughput systems and methods could 
be applied for surveying the vast space of possible entities 
from plants, and for identifying desirable entities from such 
sources for food applications. 


SUMMARY 


[0006] The present disclosure addresses the need in the art 
for analyzing the foaming of the vast space of entities 
obtained from plants and selecting desired entities from such 
sources for food applications. 

[0007] In accordance with some embodiments of the cur- 
rent invention, a system for high throughput foam analysis 
includes a foam generation system, an illumination source, 
a detection system and an analysis system. 

[0008] The foam generation system includes a first plu- 
rality of foaming units. Each foaming unit in the first 
plurality of foaming units includes a foaming chamber, 
configured to independently accommodate a respective solu- 
tion in a first plurality of solutions, and a gas induction 
mechanism configured to introduce a gas into the respective 
solution in the foaming chamber as part of a foaming process 
that generates a foam in the foaming chamber. 

[0009] The illumination source provides an illumination to 
the foaming chamber of each foaming unit in the first 
plurality of foaming units. 
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[0010] The detection system includes a first camera con- 
figured to temporally record the foaming process in the 
foaming chamber of each foaming unit in the first plurality 
of foaming units. The detection system thereby produces a 
first plurality of frames, where each respective frame in the 
first plurality of frames is representative of the foaming 
process in the foaming chamber of each foaming unit in the 
first plurality of foaming units at a corresponding discrete 
time point in a plurality of discrete time points. 


[0011] The analysis system is in communication with the 
detection system. The analysis system includes at least one 
processor and a memory addressable by the at least one 
processor and stores at least one program for execution by 
the at least one processor. The at least one program includes 
instructions for obtaining a first respective frame in the first 
plurality of frames. The at least one program further includes 
instructions for segmenting the first respective frame into a 
first plurality of segmented images. Each respective seg- 
mented image in the first plurality of segmented images is 
representative of a corresponding foaming chamber, 
together with the respective solution and/or the foam in the 
corresponding foaming chamber of a respective foaming 
unit in the first plurality of foaming units. The at least one 
program further includes instructions for extracting, from 
each segmented image in the first plurality of segmented 
images, one or more characteristics of the foam generated in 
the corresponding foaming chamber of each foaming unit in 
the first plurality of foaming units, thereby facilitating high 
throughput foam analysis of the first plurality of solutions. 


[0012] In some embodiments, the foam generation system 
further includes a second plurality of foaming units. Each 
foaming unit in the second plurality of foaming units 
includes a foaming chamber configured to independently 
accommodate a respective solution in a second plurality of 
solutions, and a gas induction mechanism configured to 
introduce a gas into the respective solution in the foaming 
chamber as part of a foaming process that generates a foam 
in the foaming chamber. The illumination source provides an 
illumination to the foaming chamber of each foaming unit in 
the second plurality of foaming units. The detection system 
further includes a second camera configured to temporally 
record the foaming process in the foaming chamber of each 
foaming unit in the second plurality of foaming units. The 
detection system thereby produces a second plurality of 
frames, each respective frame in the second plurality of 
frame representative of the foaming process in the foaming 
chamber of each foaming unit in the second plurality of 
foaming units at a corresponding discrete time point in the 
plurality of discrete time points. The at least one program of 
the analysis system further includes instructions for (i) 
obtaining a second respective frame in the second plurality 
of frames, (ii) segmenting the second respective frame into 
a second plurality of segmented images, each respective 
segmented image in the second plurality of segmented 
images representative of a corresponding foaming chamber, 
together with the respective solution and/or the foam in the 
corresponding foaming chamber of a respective foaming 
unit in the second plurality of foaming units, and (iii) 
extracting from each segmented image in the second plu- 
rality of segmented images, one or more characteristics of 
the foam generated in the corresponding foaming chamber 
of each foaming unit in the second plurality of foaming 
units, thereby facilitating high throughput foam analysis of 
the second plurality of solutions. 
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[0013] In some embodiments, the at least one program of 
the analysis system further includes instructions for (i) 
obtaining a third respective frame in the first plurality of 
frames, (ii) segmenting the third respective frame into a third 
plurality of segmented images, each respective segmented 
image in the third plurality of segmented images represen- 
tative of a corresponding foaming chamber, together with 
the respective solution and/or the foam in the corresponding 
foaming chamber of a respective foaming unit in the first 
plurality of foaming units, and (iii) extracting, from each 
segmented image in the third plurality of segmented images, 
one or more characteristics of the foam generated in the 
corresponding foaming chamber of each foaming unit in the 
first plurality of foaming units, thereby facilitating high 
throughput foam analysis of the first plurality of solutions. 
[0014] In some embodiments, the at least one program of 
the analysis system further includes instructions for (i) 
obtaining a fourth respective frame in the second plurality of 
frames, (ii) segmenting the fourth respective frame into a 
fourth plurality of segmented images, each respective seg- 
mented image in the fourth plurality of segmented images 
representative of a corresponding foaming chamber, 
together with the respective solution and/or the foam in the 
corresponding foaming chamber of a respective foaming 
unit in the second plurality of foaming units, and (iii) 
extracting from each segmented image in the fourth plurality 
of segmented images, one or more characteristics of the 
foam generated in the corresponding foaming chamber of 
each foaming unit in the second plurality of foaming units, 
thereby facilitating high throughput foam analysis of the 
second plurality of solutions. 

[0015] In another aspect, a system for high throughput 
foam analysis includes the illumination source, the detection 
system and the analysis system, as described above, and a 
foam generation system. The foam generation system 
includes a first plurality of foaming units, each foaming unit 
in the first plurality of foaming unit including a foaming 
chamber configured to independently accommodate a 
respective solution in a first plurality of solutions. Each 
solution in each foaming unit in the first plurality of foaming 
units undergoes an independent foaming process, thereby 
generating a respective foam in the foaming chamber of 
each foaming unit in the first plurality of foaming units. In 
some embodiments, the foam generation system further 
includes a second plurality of foaming units, each foaming 
unit in the second plurality of foaming units including a 
foaming chamber configured to independently accommo- 
date a respective solution in a second plurality of solutions. 
Each solution in each foaming unit in the second plurality of 
foaming units undergoes an independent foaming process, 
thereby generating a respective foam in the foaming cham- 
ber of each foaming unit in the second plurality of foaming 
units. 

[0016] In another aspect, a system for high throughput 
foam analysis includes the foam generation system, the 
illumination system and the detection system, as described 
above. In some embodiments, the further includes the analy- 
sis system in communication with the detection system. 
[0017] In some embodiments, the foaming chamber of 
each foaming unit in all or a subset of the first plurality of 
foaming units is characterized by a substantially rectangular 
cross section. 

[0018] Insome embodiments, the first plurality of foaming 
units is in an integrated block. 


Jul. 28, 2022 


[0019] In some embodiment, each respective foaming unit 
in all or a subset of the first plurality of foaming units 
includes a porous member that separates the foaming cham- 
ber of the respective foaming unit into a first portion and a 
second portion. The respective solution of the respective 
foaming unit is received in the second portion of the foaming 
chamber. The gas induction mechanism of the respective 
foaming unit includes a vacuum source in fluid communi- 
cation with the second portion of the foaming chamber to 
pull the gas from the first portion to the second portion, 
thereby introducing the gas into the respective solution and 
generating the foam in the foaming chamber of the respec- 
tive foaming unit. 


[0020] In some embodiments, the gas induction mecha- 
nism of each respective foaming unit in all or a subset of the 
first plurality of foaming units includes a porous sparger 
disposed in the foaming chamber of the respective foaming 
unit. The porous sparger is in fluid communication with a 
gas supply to introduce the gas into the respective solution 
of the respective foaming unit, thereby generates the foam in 
the foaming chamber of the respective foaming unit. 


[0021] In some embodiments, each respective foaming 
unit in a first subset of the first plurality of foaming units 
includes a porous member that separates the foaming cham- 
ber of the respective foaming unit into a first portion and a 
second portion. The respective solution of the respective 
foaming unit is received in the second portion of the foaming 
chamber. The gas induction mechanism of the respective 
foaming unit includes a vacuum source in fluid communi- 
cation with the second portion of the foaming chamber to 
pull the gas from the first portion to the second portion, 
thereby introducing the gas into the respective solution and 
generating the foam in the foaming chamber of the respec- 
tive foaming unit in the first subset of the first plurality of 
foaming units. The gas induction mechanism of each respec- 
tive foaming unit in a second subset of the first plurality of 
foaming units includes a porous sparger disposed in the 
foaming chamber of the respective foaming unit. The porous 
sparger is in fluid communication with a gas supply to 
introduce the gas into the respective solution of the respec- 
tive foaming unit, thereby generates the foam in the foaming 
chamber of the respective foaming unit in the second subset 
of the first plurality of foaming units. 


[0022] In some embodiments, the porous member is a frit, 
and the frit has a pore size range between 10 um and 20 um, 
between 20 um and 30 um, or between 30 um and 40 um. In 
some embodiments, the frit has an average pore size that is 
between 10 um and 20 um, between 20 um and 30 um, or 
between 30 um and 40 um. 


[0023] In some embodiments, each respective porous 
sparger has an active porous length and a pore size range 
between 2 um and 5 um, between 5 um and 10 um, between 
10 um and 15 um, or between 15 um and 20 um. The sparger 
is configured such that the active porous length of the 
respective sparger is submerged in the corresponding solu- 
tion before generating the foam. 


[0024] In some embodiments, the foaming chamber of 
each respective foaming unit in all or a subset of the first 
plurality of foaming units has linear dimensions between 25 
mm and 100 mm, between 100 mm and 400 mm, or between 
400 mm and 900 mm. 


[0025] In some embodiments, the corresponding solution 
for each respective foaming unit in all or a subset of the first 
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plurality of foaming units has a volume ranging between 1 
ml and 2.5 ml, between 2.5 ml and 10 ml, or between 10 ml 
and 20 ml. 

[0026] In some embodiments, at each respective foaming 
unit in all or a subset of the first plurality of foaming units, 
the gas introduced into the respective solution is approxi- 
mately 1 times, 1.5 times, 2 times, 2.5 times, or 3 times that 
of the volume of solution in the foaming chamber of the 
respective foaming unit. 

[0027] In some embodiments, at each respective foaming 
unit in all or a subset of the first plurality of foaming units, 
the gas is introduced into the solution at a flow rate lower 
than 200 ml/sec, lower than 150 ml/sec, lower than 100 
m/sec, or lower than 50 ml/sec. 

[0028] In some embodiments, each respective foaming 
unit in all or a subset of the first plurality of foaming units 
further includes a meter to control a flow rate of the gas or 
a total amount of the gas introduced into the respective 
solution. 

[0029] In some embodiments, at each respective foaming 
unit in all or a subset of the first plurality of foaming units, 
the gas is selected from the group consisting essentially of 
air, nitrogen, carbon dioxide, and noble gas. 

[0030] In some embodiments, the gas introduced into the 
solution at each respective foaming unit in a first subset of 
the first plurality of foaming units is different than the gas 
introduced into the solution at each respective foaming unit 
in a second subset of the first plurality of foaming units. 
[0031] In some embodiments, at each respective foaming 
unit in all or a subset of the first plurality of foaming units, 
the corresponding solution contains a protein, a concentra- 
tion thereof ranging between 1% and 9%, or between 1% 
and 15%. 

[0032] In some embodiments, at each respective foaming 
unit in all or a subset of the first plurality of foaming units, 
the corresponding solution comprises one or more plant 
proteins. 

[0033] In some embodiments, in the first plurality of 
solutions, at least two solutions are different from each other 
(e.g., in terms of concentrations). 

[0034] In some embodiments, at one or each respective 
foaming unit in the first plurality and/or the second plurality 
of foaming units, the corresponding solution is prepared by 
mixing (i) a protein and (ii) an additive. 

[0035] In some embodiments, the foam generation system 
further includes a first sample rack to hold all or a subset of 
the first plurality of forming units. 

[0036] In some embodiments, the foam generation system 
further includes a first sample rack to hold the first and 
second pluralities of forming units. 

[0037] In some embodiments, all or a subset of the first 
plurality of forming units are monolithically made of one 
unit. 

[0038] In some embodiments, the foam generation system 
is disposed between the illumination source and the detec- 
tion system. 

[0039] In some embodiments, the illumination source 
includes a light-emitting diode (LED) panel, and the first 
plurality of foaming units of the foam generation system are 
arranged in a line parallel to the LED panel. In some 
embodiments, the LED is configured to emit a green light, 
or to emit a light with a wavelength of approximately 530 
nm. 
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[0040] In some embodiments, the detection system further 
includes a first telecentric lens optically disposed between 
the first plurality of foaming units and the first camera, and 
optically coupled with the first camera. The first telecentric 
lens produces an orthogonal projection of the first plurality 
of foaming units to the first camera, thereby reducing 
distortion and improving resolution of each respective frame 
in the first plurality of frames. 

[0041] In some embodiments, the detection system 
includes the first lens and further includes a second telecen- 
tric lens optically disposed between the second plurality of 
foaming units and the second camera, and optically coupled 
with the second camera. The second telecentric lens pro- 
duces an orthogonal projection of the second plurality of 
foaming units to the second camera, thereby reducing dis- 
tortion and improving resolution of each respective frame in 
the second plurality of frames. 

[0042] In some embodiments, the first camera includes a 
first built-in telecentric lens configured to produce an 
orthogonal projection of the first plurality of foaming units 
to a first sensor of the first camera, thereby reducing distor- 
tion and improving resolution of each respective frame in 
the first plurality of frames. 

[0043] Insome embodiments, the first camera includes the 
first built-in telecentric lens, and the second camera includes 
a second built-in telecentric lens configured to produce an 
orthogonal projection of the second plurality of foaming 
units to a second sensor of the second camera, thereby 
reducing distortion and improving resolution of each respec- 
tive frame in the second plurality of frames. 

[0044] In some embodiments, the one or each time inter- 
val of two adjacent time points in the plurality of discrete 
time points is 5 seconds, 6 seconds, 7 seconds, 8 seconds, 9 
seconds, 10 seconds, 12 seconds, 15 seconds, or 20 seconds. 
In some embodiments, the first plurality of frames is a first 
video, and the first video has a duration that is up to 5 
minutes, 10 minutes, 15 minutes, or 20 minutes. 

[0045] In some embodiments, the extracted one or more 
characteristics of the foam includes one or more of the 
following: a height of the foam, bubble sizes, a distribution 
of bubble sizes, bubble shapes, bubble center coordinates, a 
bubble area, equivalent diameters of bubbles, perimeters of 
bubbles, a bubble circularity, a bubble solidity, a first bubble 
aspect ratio, a second bubble aspect ratio, a third bubble 
aspect ratio, a first bubble extent, a second bubble extent, a 
third bubble extent and a fourth bubble extent. 

[0046] In some embodiments, the segmenting of the first 
respective frame into the first plurality of segmented images 
includes creating a binary image from the first frame, 
selecting a plurality of contours from the binary image, each 
contour in the plurality of contours corresponding to an 
outline of the foaming chamber of the foaming unit corre- 
sponding to the first frame, and partitioning the respective 
frame in accordance with the plurality of contours, thereby 
producing the plurality of segmented images. 

[0047] In some embodiments, the creating of the binary 
image includes converting the first frame into a grayscale 
image, and using a threshold to binarize the grayscale image, 
thereby creating the binary image. 

[0048] In some embodiments, the segmenting of the 
respective frame into the plurality of segmented images 
further includes one or more of the following: removing, 
subsequent to the creating of the binary image and prior to 
the selecting of the plurality of contours, noises from the 
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binary image; and cropping each respective segmented 
image in all or a subset of the plurality of segmented images 
along a width direction of the respective segmented image 
from a first side and a second side of the respective seg- 
mented image to reduce impact of a first side wall and a 
second side wall of the corresponding chamber on subse- 
quent image analysis. The cropping is up to 5%, 10%, 15%, 
20%, 25%, or 30%. 

[0049] In some embodiments, for each respective seg- 
mented image in all or a subset of the plurality of segmented 
images, the extracting of the one or more characteristics of 
the foam includes one or more of the following: extracting 
one or more dimensions of the foam, and extracting one or 
more properties of bubbles in the foam. 


[0050] In some embodiments, each respective segmented 
image in all or a subset of the plurality of segmented images 
includes a plurality of first subregion types, each first 
subregion type in the plurality of first subregion types 
including a plurality of contiguous pixels, and each pixel in 
the plurality of pixels has a pixel value representative of a 
brightness of the pixel. For the respective segmented image 
in the plurality of segmented images, the extracting of the 
one or more dimensions of the foam includes calculating a 
pixel value variance of each first subregion type in the 
plurality of first subregion types, and determining whether 
the calculated pixel value variance of each first subregion 
type in the plurality of first subregion types and cutoff values 
is between a first cutoff value and a second cutoff value, or 
between the second and a third cutoff value (e.g., the first 
cutoff value is up to 2 or up to 5; the second cutoff value is 
up to 30, or up to 50, and the third cutoff value is up to 800, 
or up to 1000. The extracting of the one or more dimensions 
of the foam also includes identifying one or more boundar- 
ies. The one or more boundaries includes a solution-foam 
boundary between the respective solution and the foam in 
the corresponding foaming chamber at the corresponding 
discrete time point. The first subregion types with the pixel 
value variances between the first cutoff value and the second 
cutoff value represent the solution, and first subregion types 
with the pixel value variances between the second cutoff 
value and the third cutoff value represent the foam. The 
extracting of the one or more dimensions of the foam also 
includes height of the foam in the corresponding chamber at 
the corresponding discrete time point by counting the num- 
ber of first subregion types from the solution-foam boundary 
to a top of the segmented image. Optionally or additionally, 
the extracting of the one or more dimensions of the foam 
also includes determining a height of the solution in the 
corresponding chamber at the corresponding discrete time 
point by counting the number of first subregion types from 
a bottom of the segmented image to the solution-foam 
boundary. 


[0051] In some embodiments, the one or more boundaries 
further includes a foam-gas boundary between the gas and 
the foam in the corresponding foaming chamber at the 
corresponding discrete time point, and a solution-chamber 
boundary between the solution and the corresponding foam- 
ing chamber at the corresponding discrete time point. The 
first subregion types with the pixel value variances less than 
the first cutoff value represent the gas. A first subregion type 
at the foam-gas boundary has the pixel value exceeding the 
third cutoff value. A first subregion type at the solution- 
chamber boundary has the pixel value exceeding the third 
cutoff value. The height of the foam in the corresponding 
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chamber at the corresponding discrete time point is deter- 
mined by counting the number of first subregion types from 
the solution-foam boundary to the foam-gas boundary. The 
height of the solution in the corresponding chamber at the 
corresponding discrete time point is determined by counting 
the number of first subregion types from the solution- 
chamber boundary to the solution-foam boundary. 

[0052] In some embodiments, each respective segmented 
image in all or a subset of the plurality of segmented images 
includes a plurality of first subregion types. Each first 
subregion type in the plurality of first subregion types 
includes a plurality of contiguous pixels, and each pixel in 
the plurality of pixels has a pixel value representative of a 
brightness of the pixel. For the respective segmented image, 
the extracting of the one or more dimensions of the foam 
includes calculating a pixel value variance of each first 
subregion type in the plurality of first subregion types, 
generating a graphic with the calculated pixel value vari- 
ances as a function of the first subregion types of the 
segmented image, and graphically determining a height of 
the foam and/or a height of the solution at the corresponding 
discrete time point, using one or more of first, second and 
third cutoff values. 

[0053] In some embodiments, each respective segmented 
image in all or a subset of the plurality of segmented images 
includes a plurality of first subregion types, each first 
subregion type in the plurality of first subregion types 
includes a plurality of contiguous pixels, and each pixel in 
the plurality of pixels has a pixel value representative of a 
brightness of the pixel. For the respective segmented image 
in the plurality of segmented images, the extracting of the 
one or more dimensions of the foam includes determining an 
image gradient for the one or more corresponding grayscale 
images of the partially foamed liquid and determining the 
number of directional changes for each first subregion type 
and each second subregion type in the image gradient. The 
extracting also includes classifying the first subregion types 
of pixels in the one or more corresponding binary images of 
the partially foamed liquid as corresponding to a solution 
phase or a foam, thereby identifying the location of a 
solution phase and a foam phase of the first material con- 
tained within the first chamber. A height of the foam in the 
corresponding chamber at the corresponding discrete time 
point is determined by counting the number of first subre- 
gion types corresponding to the foam phase. Optionally or 
additionally, A height of the solution in the corresponding 
chamber at the corresponding discrete time point is deter- 
mined by counting the number of first subregion types 
corresponding to the solution phase. 

[0054] In some embodiments, the pixel value of each pixel 
is stored as an 8-bit integer having a value ranging from 0 
to 255, where in 0 represents black in the segmented image, 
and 255 represents white in the segmented image. 

[0055] In some embodiments, the extracting of the one or 
more properties of bubbles in the foam further includes for 
each respective segmented image in all or a subset of the 
plurality of segmented images, cropping the respective seg- 
mented image along a height direction of the respective 
segmented image to remove pixels below the solution-foam 
boundary and/or above the foam-gas boundary, thereby 
producing a foam regional image. 

[0056] In some embodiments, the extracting of the one or 
more properties of bubbles in the foam further includes 
converting, if the foam regional image is not a grayscale 
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image, the foam regional image into a grayscale foam 
regional image. Optionally or additionally, the extracting of 
the one or more properties of bubbles in the foam further 
includes removing noises from the foam regional image or 
from the grayscale foam regional image, and creating a 
binary foam regional image from the foam regional image or 
from the grayscale foam regional image. The binary foam 
regional image includes a plurality of blobs. Each blob in the 
plurality of blobs includes one or more pixels, and each pixel 
in the one or more pixels of each blob has a first pixel value. 


[0057] In some embodiments, the noises are removed by 
Gaussian blurring, median blurring, bilateral filtering, box 
filtering, or any combination thereof. In some embodiments, 
the Gaussian blurring is performed using a 3x3 kernel, or a 
5x5 kernel. 


[0058] In some embodiments, the binary foam regional 
image is created by an Otsu’s method, an adaptive mean 
thresholding method, an adaptive Gaussian thresholding 
method, or a thresholding method with a manually set 
threshold. 


[0059] In some embodiments, the extracting of the one or 
more properties of bubbles in the foam further includes (i) 
determining whether a size of a respective blob in the 
plurality of blobs is smaller than a minimum blob size 
representative of a minimum bubble size; (ii) discarding the 
respective blob if it is determined that its size is smaller than 
the minimum blob size; (iii) repeating (i) and (ii) for each 
blob in the plurality of blobs, thereby producing a subset of 
blobs. Each blob in the subset of blobs has the size equal to 
or larger than the minimum blob size; and (iv) eroding the 
binary foam regional image to obtain center coordinates of 
each blob in the subset of blobs. In some embodiments, the 
eroding of the binary foam regional image to obtain the 
center coordinates of each blob in the subset of blobs 
includes (i) shrinking the sizes of the blobs in the subset of 
blobs; (ii) determining whether the size of a respective 
shrunken blob in the subset of blobs is smaller than the 
minimum blob size; (iii) recording a position of the respec- 
tive shrunken blob as its center coordinates, if it is deter- 
mined that the size of the respective shrunken blob in the 
subset of blobs is smaller than a minimum blob size; and (iv) 
repeating steps (1)-(iii) until none of the shrunken blobs in 
the subset of blobs has the size exceeding the minimum size. 
In some embodiments, the eroding of the binary foam 
regional image to obtain the center coordinates of each blob 
in the subset of blobs is performed using a 3x3 kernel or a 
5x5 kernel. In some embodiments, the minimum size is up 
to 8 pixels in radius, up to 10 pixels in radius, or up to 15 
pixels in radius. 


[0060] In some embodiments, the extracting of the one or 
more properties of bubbles in the foam further includes 
using a distance transformation to locate a plurality of local 
maxima, and designating the plurality of local maxima as the 
center coordinates of the plurality of blobs. 


[0061] In some embodiments, a center of each blob in all 
or a subset of plurality of blobs is represented by a circle 
having a radius up to 3 pixels in radius, up to 5 pixels in 
radius, or up to 8 pixels in radius. 


[0062] In some embodiments, the extracting of the one or 
more properties of bubbles in the foam further includes 
determining a peripheral boundary of each blob in the 
plurality of blobs or in the subset of the plurality of blobs, 
and generating a blob segmentation image in accordance 
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with the determined peripheral boundary of each blob in the 
plurality of blobs or in the subset of the plurality of blobs. 


[0063] In some embodiments, the determining of the 
peripheral boundary of each blob in the plurality of blobs or 
in the subset of the plurality of blobs includes: (1) calculating 
a distance of each pixel in the binary foam regional image 
to its nearest pixel that has a second pixel value, thereby 
producing a distance transformed image; (ii) using the 
obtained center coordinates of each blob in the plurality of 
blobs or in the subset of the plurality of blobs as a starting 
point to watershed the distance transformed image, thereby 
producing a plurality of watershed regions, where each 
watershed region in the plurality of watershed regions has a 
boundary; (iii) assigning the boundaries of the plurality of 
watershed regions as ridges of the plurality of watershed 
regions; and (iv) determining the peripheral boundary of 
each blob in the plurality of blobs or in the subset of the 
plurality of blobs in accordance with the ridges of the 
plurality of watershed regions. 


[0064] In some embodiments, the at least one program 
further includes instructions for: (i) determining whether 
two adjacent blobs in the blob segmentation image are 
overlapped; (ii) merging the two adjacent blobs into one 
blob, if it is determined that the two adjacent blobs in the 
blob segmentation image are overlapped; and (iii) optionally 
or additionally, repeating (i) and (ii), thereby producing a 
modified blob segmentation image. 


[0065] In some embodiments, the two adjacent blobs in 
the blob segmentation image are determined to be over- 
lapped, if a criteria of d<min(r1, r2) is met, and where r1 and 
r2 stand for radii of minimum bound circles of the two 
adjacent blobs, and d stands for a distance between centers 
of the minimum bound circles of the two adjacent blobs. 


[0066] In some embodiments, the merging of the two 
adjacent blobs into one blob is conducted by dilating each of 
the two adjacent blobs. 


[0067] In some embodiments, the extracting of the one or 
more properties of bubbles in the foam further includes: for 
each respective blob in all or a subset of the blob segmen- 
tation image or in the modified blob segmentation image, 
calculating one or more of the following: an area A sur- 
rounded by the peripheral boundary of the respective blob; 
an equivalent diameter of the respective blob using a for- 
mula of sqrt (4xA/m); a perimeter C of the peripheral 
boundary of the respective blob; a circularity of the respec- 
tive blob using a formula of 4xmxA/C’; a solidity of the 
respective blob using a formula of A/HA, HA stands for a 
convex hull area; a first aspect ratio of the respective blob 
using a formula of min(al, b1)/max(al, b1), where al and b1 
stand for width and height of a bounding rectangle, respec- 
tively; a second aspect ratio of the respective blob using a 
formula of min(a2, b2)/max(a2, b2), where a2 and b2 stand 
for width and height of a minimum bounding rectangle, 
respectively; a third aspect ratio of the respective blob using 
a formula of min(a3, b3)/max(a3, b3), where a3 and b3 stand 
for lengths of two axes of a fitted ellipse, respectively; a first 
extent of the respective blob using a formula of A/BRA, 
where BRA stands for an area of a bounding rectangle; a 
second extent of the respective blob using a formula of 
A/mBRA, where mBRA stands for an area of a minimum 
bounding rectangle; a third extent of the respective blob 
using a formula of A/mBCA, where mBCA stands for an 
area of a minimum bounding circle; and a fourth extent of 
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the respective blob using a formula of A/EA, where EA 
stands for an area of a fitted ellipse. 

[0068] In some embodiments, the at least one program 
further includes instructions for clustering the blobs in the 
blob segmentation image or in the modified blob segmen- 
tation image into two or more clusters. 

[0069] In some embodiments, the blobs are clustered in 
accordance with one or more properties selected from the 
circularity, solidity, first aspect ratio, second aspect ratio, 
third aspect ratio, first extent, second extent, third extent and 
fourth extent of each blob in the blob segmentation image or 
in the modified blob segmentation image. 

[0070] In some embodiments, a principle component 
analysis is performed to select the one or more properties 
selected from the circularity, solidity, first aspect ratio, 
second aspect ratio, third aspect ratio, first extent, second 
extent, third extent and fourth extent of each blob in the blob 
segmentation image or in the modified blob segmentation 
image. 

[0071] In some embodiments, the clustering of the blobs is 
performed using a K-means clustering algorithm to mini- 
mize a within-cluster sum of squares: 


at le 
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[0072] where, 
[0073] each x, in (X,, Xa, ..., X,,) is a blob, 
[0074] kis the number of clusters, 
[0075] each S={S,, S,..., S} is a set of blobs 


clustered into each cluster set, and 
[0076] each u, in (u,, u,,... , u‚) is a centroid of a 
corresponding cluster. 

[0077] In some embodiments, the at least one program 
further includes instructions for: classifying the blobs in the 
blob segmentation image, the blobs in the modified blob 
segmentation image, or the blobs in a first cluster that has a 
larger or a largest number of blobs among the two or more 
clusters, into bubble blobs and non-bubble blobs, by one or 
more of the following: classifying the blobs manually, and 
classifying the blobs using a bubble model. The at least one 
program further includes instructions for generating a final 
set of blobs including each blob of the subset blobs in the 
blob segmentation image, the subset blobs in the modified 
blob segmentation image, or the subset blobs in a first cluster 
that has a larger or a largest number of blobs among the two 
or more clusters classified as a bubble blobs. 
[0078] In some embodiments, the at least one program 
further includes instructions for: selecting a first cluster that 
has a larger or a largest number of blobs from the two or 
more clusters, designating the blobs in the first cluster as a 
final set of blobs representative of the bubbles in the foam, 
and optionally or additionally, discarding remaining clusters 
in the two or more clusters. 
[0079] In some embodiments, the at least one program 
further includes instructions for: selecting a first cluster that 
has a larger or a largest number of blobs from the two or 
more clusters; comparing the blobs in the first cluster with 
the bubbles in the foam to identify one or more bubble blobs, 
and/or one or more non-bubble blobs, where each bubble 
blob in the one or more bubble blobs corresponds to a bubble 
in the foam, and each non-bubble blob in the one or more 
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non-bubble blobs has no corresponding bubble in the foam; 
constructing a training set including (i) the identified one or 
more bubble blobs, (ii) the identified one or more non- 
bubble blobs, and/or (iii) one or more blobs in a second 
cluster in the two or more clusters as non-bubble blobs; and 
deriving, using the training set, a bubble model to classify 
blobs in accordance with the one or more extracted proper- 
ties of bubbles. 

[0080] In some embodiments, the at least one program 
further includes instructions for updating the training set 
and/or refining the bubble model. 

[0081] In some embodiments, the at least one program 
further includes instructions for constructing a training set to 
classify blobs. The constructing includes one or more of the 
following: labeling the blobs in the blob segmentation 
image, the blobs in the modified blob segmentation image, 
or the blobs in a first cluster that has a larger or a largest 
number of blobs among the two or more clusters; drawing 
contours of the blobs in the blob segmentation image, the 
blobs in the modified blob segmentation image, or the blobs 
in a first cluster that has a larger or a largest number of blobs 
among the two or more clusters; and generating one or more 
data files, each data file in the one or more data files 
including one or more of the following: the extracted one or 
more characteristics of the foam in the foaming chamber of 
each respective foaming unit in all or a subset of the first 
plurality of foaming units; the final set of blobs; images with 
labeled blobs and/or drawn contours; and the first plurality 
of frames and/or the second plurality of frames. At least one 
frame of the first plurality of frames or the second plurality 
of frames has labeled blobs and/or drawn contours. 

[0082] In accordance with some embodiments, a method 
for high throughput foam analysis includes introducing a gas 
into a corresponding solution contained in a foaming cham- 
ber of each respective foaming unit in a first plurality of 
foaming units such that the corresponding solution under- 
goes a foaming process, thereby generating a foam in the 
foaming chamber of each respective foaming unit in the first 
plurality of foaming units. The method also includes record- 
ing the foaming process in the foaming chamber of each 
respective foaming unit in the first plurality of foaming units 
to produce a first plurality of frames, each respective frame 
in the first plurality of frames representative of the foaming 
process in the foaming chamber of each foaming unit in the 
first plurality of foaming units at a corresponding discrete 
time point in a plurality of discrete time points. The method 
further includes obtaining a first respective frame in the first 
plurality of frames, and segmenting the first respective frame 
into a first plurality of segmented images, each respective 
segmented image in the first plurality of segmented images 
representative of a corresponding foaming chamber, 
together with the respective solution and/or the foam in the 
corresponding foaming chamber of a respective foaming 
unit in the first plurality of foaming units at the correspond- 
ing discrete time point. The method further includes extract- 
ing, from each segmented image in the first plurality of 
segmented images, one or more characteristics of the foam 
generated in the corresponding foaming chamber of each 
foaming unit in the first plurality of foaming units at the 
corresponding discrete time point, thereby facilitating high 
throughput foam analysis of the first plurality of solutions. 
[0083] In some embodiments, the method further includes 
introducing a gas into a corresponding solution contained in 
a foaming chamber of each respective foaming unit in a 
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second plurality of foaming units such that the correspond- 
ing solution undergoes a foaming process, thereby generat- 
ing a foam in the foaming chamber of each respective 
foaming unit in the second plurality of foaming units. The 
method also includes recording the foaming process in the 
foaming chamber of each respective foaming unit in the 
second plurality of foaming units to produce a second 
plurality of frames, each respective frame in the second 
plurality of frames representative of the foaming process in 
the foaming chamber of each foaming unit in the second 
plurality of foaming units at a corresponding discrete time 
point in the plurality of discrete time points. The method 
further includes obtaining a second respective frame in the 
second plurality of frames, and segmenting the second 
respective frame into a second plurality of segmented 
images, each respective segmented image in the second 
plurality of segmented images representative of a corre- 
sponding foaming chamber, together with the respective 
solution and/or the foam in the corresponding foaming 
chamber of a respective foaming unit in the second plurality 
of foaming units at the corresponding discrete time point. 
The method further includes extracting, from each seg- 
mented image in the second plurality of segmented images, 
one or more characteristics of the foam generated in the 
corresponding foaming chamber of each foaming unit in the 
second plurality of foaming units at the corresponding 
discrete time point, thereby facilitating high throughput 
foam analysis of the second plurality of solutions. 

[0084] In some embodiments, the introducing of the gas 
into the corresponding solution contained in the foaming 
chamber of each respective foaming unit in the first plurality 
of foaming units and the introducing of the gas into the 
corresponding solution contained in the foaming chamber of 
each respective foaming unit in the second plurality of 
foaming units are conducted simultaneously. The recording 
of the foaming process in the foaming chamber of each 
respective foaming unit in the first plurality of foaming units 
and the recording of the foaming process in the foaming 
chamber of each respective foaming unit in the second 
plurality of foaming units are conducted simultaneously. 
[0085] In some embodiments, the introducing of the gas 
into the corresponding solution contained in the foaming 
chamber of each respective foaming unit in the first plurality 
of foaming units and the introducing of the gas into the 
corresponding solution contained in the foaming chamber of 
each respective foaming unit in the second plurality of 
foaming units are conducted sequentially. The recording of 
the foaming process in the foaming chamber of each respec- 
tive foaming unit in the first plurality of foaming units and 
the recording of the foaming process in the foaming cham- 
ber of each respective foaming unit in the second plurality 
of foaming units are conducted sequentially. 

[0086] In some embodiments, the method further includes 
one or more of the following: preparing the first plurality of 
solutions; preparing the second plurality of solutions; intro- 
ducing the first plurality of solutions into the foaming 
chambers of the first plurality of foaming units; and intro- 
ducing the second plurality of solutions into the foaming 
chambers of the second plurality of foaming units. 

[0087] In accordance with some embodiments, a method 
for high throughput foam analysis includes obtaining a first 
respective frame from a first plurality of frames. The first 
plurality of frames is produced by temporally recording a 
respective foaming process in each foaming chamber of 
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each foaming unit in a first plurality of foaming units, each 
respective frame in the first plurality of frames representa- 
tive of the foaming process in the foaming chamber of each 
foaming unit in the first plurality of foaming units at a 
corresponding discrete time point in a plurality of discrete 
time points. The method also includes segmenting the first 
respective frame into a first plurality of segmented images, 
each respective segmented image in the first plurality of 
segmented images representative of a corresponding foam- 
ing chamber, together with the respective solution and/or the 
foam in the corresponding foaming chamber of a respective 
foaming unit in the first plurality of foaming units at the 
corresponding discrete time point. The method further 
includes extracting, from each segmented image in the first 
plurality of segmented images, one or more characteristics 
of the foam generated in the corresponding foaming cham- 
ber of each foaming unit in the first plurality of foaming 
units at the corresponding discrete time point, thereby facili- 
tating high throughput foam analysis of the first plurality of 
solutions. 

[0088] In some embodiments, the method also includes 
obtaining a second respective frame from a second plurality 
of frames. The second plurality of frames is produced by 
temporally recording a respective foaming process in each 
foaming chamber of each foaming unit in a second plurality 
of foaming units, each respective frame in the second 
plurality of frames representative of the foaming process in 
the foaming chamber of each foaming unit in the second 
plurality of foaming units at a corresponding discrete time 
point in the plurality of discrete time points. The method also 
includes segmenting the second respective frame into a 
second plurality of segmented images, each respective seg- 
mented image in the second plurality of segmented images 
representative of a corresponding foaming chamber, 
together with the respective solution and/or the foam in the 
corresponding foaming chamber of a respective foaming 
unit in the second plurality of foaming units at the corre- 
sponding discrete time point. The method further includes, 
extracting, from each segmented image in the second plu- 
rality of segmented images, one or more characteristics of 
the foam generated in the corresponding foaming chamber 
of each foaming unit in the second plurality of foaming units 
at the corresponding discrete time point, thereby facilitating 
high throughput foam analysis of the second plurality of 
solutions. 

[0089] In some embodiments, the segmenting of the 
respective frame into a plurality of segmented images 
includes creating a binary image from the respective frame, 
selecting a plurality of contours from the binary image, each 
contour in the plurality of contours corresponding to an 
outline of the foaming chamber of a respective foaming unit 
in the first or second plurality of foaming units, and parti- 
tioning the respective frame in accordance with the plurality 
of contours, thereby producing the plurality of segmented 
images. 

[0090] In some embodiments, the creating of the binary 
image includes: converting the respective frame into a 
grayscale image; and using a threshold to binarize the 
grayscale image, thereby creating the binary image. 

[0091] In some embodiments, the segmenting of the 
respective frame into the plurality of segmented images 
further includes one or more of the following: removing, 
subsequent to the creating of the binary image and prior to 
the selecting of the plurality of contours, noises from the 
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binary image; and cropping each respective segmented 
image in all or a subset of the plurality of segmented images 
along a width direction of the respective segmented image 
from a first side and a second side of the respective seg- 
mented image to reduce impact of a first side wall and a 
second side wall of the corresponding chamber on subse- 
quent image analysis. The cropping is up to 5%, 10%, 15%, 
20%, 25%, or 30%. 

[0092] In some embodiments, for each respective seg- 
mented image in all or a subset of the plurality of segmented 
images, the extracting of the one or more characteristics of 
the foam includes one or more of the following: extracting 
one or more dimensions of the foam; and extracting one or 
more properties of bubbles in the foam. 


[0093] In some embodiments, each respective segmented 
image in all or a subset of the plurality of segmented images 
includes a plurality of first subregion types, each first 
subregion type in the plurality of first subregion types 
includes a plurality of contiguous pixels, and each pixel in 
the plurality of pixels has a pixel value representative of a 
brightness of the pixel. For the respective segmented image, 
the extracting of the one or more dimensions of the foam 
includes: calculating a pixel value variance of each first 
subregion type in the plurality of first subregion types; 
determining whether the calculated pixel value variance of 
each first subregion type in the plurality of first subregion 
types and cutoff values is between a first cutoff value and a 
second cutoff value, or between the second and a third cutoff 
value; identifying one or more boundaries, where the one or 
more boundaries includes a solution-foam boundary 
between the respective solution and the foam in the corre- 
sponding foaming chamber at the corresponding discrete 
time point, where first subregion types with the pixel value 
variances between the first cutoff value and the second cutoff 
value represent the solution, and first subregion types with 
the pixel value variances between the second cutoff value 
and the third cutoff value represent the foam; determining a 
height of the foam in the corresponding chamber at the 
corresponding discrete time point by counting the number of 
first subregion types from the solution-foam boundary to a 
top of the segmented image; and optionally or additionally, 
determining a height of the solution in the corresponding 
chamber at the corresponding discrete time point by count- 
ing the number of first subregion types from a bottom of the 
segmented image to the solution-foam boundary. 


[0094] In some embodiments, the one or more boundaries 
further includes a foam-gas boundary between the gas and 
the foam in the corresponding foaming chamber at the 
corresponding discrete time point, and a solution-chamber 
boundary between the solution and the corresponding foam- 
ing chamber at the corresponding discrete time point. The 
first subregion types with the pixel value variances less than 
the first cutoff value represent the gas. A first subregion type 
at the foam-gas boundary has the pixel value exceeding the 
third cutoff value. A first subregion type at the solution- 
chamber boundary has the pixel value exceeding the third 
cutoff value. The height of the foam in the corresponding 
chamber at the corresponding discrete time point is deter- 
mined by counting the number of first subregion types from 
the solution-foam boundary to the foam-gas boundary, and 
the height of the solution in the corresponding chamber at 
the corresponding discrete time point is determined by 
counting the number of first subregion types from the 
solution-chamber boundary to the solution-foam boundary. 


Jul. 28, 2022 


[0095] In some embodiments, each respective segmented 
image in all or a subset of the plurality of segmented images 
includes a plurality of first subregion types, each first 
subregion type in the plurality of first subregion types 
includes a plurality of contiguous pixels, and each pixel in 
the plurality of pixels has a pixel value representative of a 
brightness of the pixel. For the respective segmented image, 
the extracting of the one or more dimensions of the foam 
includes calculating a pixel value variance of each first 
subregion type in the plurality of first subregion types, 
generating a graphic with the calculated pixel value vari- 
ances as a function of the first subregion types of the 
segmented image, and graphically determining a height of 
the foam and/or a height of the solution at the corresponding 
discrete time point, using one or more of first, second and 
third cutoff values. The one or more of first, second and third 
cutoff values are determined based on a resolution of seg- 
mented images, and depend on, e.g., size of the correspond- 
ing foaming chamber. In some embodiments, the first cutoff 
value is up to 2 or up to 5, the second cutoff value is up to 
30, or up to 50, and the third cutoff value is up to 800, or up 
to 1000. 


[0096] In some embodiments, each respective segmented 
image in all or a subset of the plurality of segmented images 
includes a plurality of first subregion types, each first 
subregion type in the plurality of first subregion types 
includes a plurality of contiguous pixels, and each pixel in 
the plurality of pixels has a pixel value representative of a 
brightness of the pixel. For the respective segmented image 
in the plurality of segmented images, the extracting of the 
one or more dimensions of the foam includes determining an 
image gradient for the one or more corresponding grayscale 
images of the partially foamed liquid and determining the 
number of directional changes for each first subregion type 
and each second subregion type in the image gradient. The 
extracting also includes classifying the first subregion types 
of pixels in the one or more corresponding binary images of 
the partially foamed liquid as corresponding to a solution 
phase or a foam, thereby identifying the location of a 
solution phase and a foam phase of the first material con- 
tained within the first chamber. A height of the foam in the 
corresponding chamber at the corresponding discrete time 
point is determined by counting the number of first subre- 
gion types corresponding to the foam phase. Optionally or 
additionally, A height of the solution in the corresponding 
chamber at the corresponding discrete time point is deter- 
mined by counting the number of first subregion types 
corresponding to the solution phase. 

[0097] In some embodiments, the pixel value of each pixel 
is stored as an 8-bit integer having a value ranging from 0 
to 255, where in 0 represents black in the segmented image, 
and 255 represents white in the segmented image. 

[0098] In some embodiments, for each respective seg- 
mented image in all or a subset of the plurality of segmented 
images, the extracting of the one or more properties of 
bubbles in the foam includes cropping the respective seg- 
mented image along a height direction of the respective 
segmented image to remove pixels below the solution-foam 
boundary and/or above the foam-gas boundary, thereby 
producing a foam regional image. 

[0099] In some embodiments, the extracting of the one or 
more properties of bubbles in the foam further includes 
converting, if the foam regional image is not a grayscale 
image, the foam regional image into a grayscale foam 
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regional image, and optionally or additionally, removing 
noises from the foam regional image or from the grayscale 
foam regional image. The extracting of the one or more 
properties of bubbles in the foam further includes creating a 
binary foam regional image from the foam regional image or 
from the grayscale foam regional image. The binary foam 
regional image includes a plurality of blobs, each blob in the 
plurality of blobs includes one or more pixels, and each pixel 
in the one or more pixels of each blob has a first pixel value. 


[0100] In some embodiments, the noises are removed by 
Gaussian blurring, median blurring, bilateral filtering, box 
filtering, or any combination thereof. In some embodiments, 
the Gaussian blurring is performed using a 3x3 kernel, or a 
5x5 kernel. 


[0101] In some embodiments, the binary foam regional 
image is created by an Otsu’s method, an adaptive mean 
thresholding method, an adaptive Gaussian thresholding 
method, or a thresholding method with a manually set 
threshold. 


[0102] In some embodiments, the extracting of the one or 
more properties of bubbles in the foam further includes: (i) 
determining whether a size of a respective blob in the 
plurality of blobs is smaller than a minimum blob size 
representative of a minimum bubble size; (ii) discarding the 
respective blob if it is determined that its size is smaller than 
the minimum blob size; (iii) repeating (i) and (ii) for each 
blob in the plurality of blobs, thereby producing a subset of 
blobs, where each blob in the subset of blobs has the size 
equal to or larger than the minimum blob size; and (iv) 
eroding the binary foam regional image to obtain center 
coordinates of each blob in the subset of blobs. 


[0103] In some embodiments, the eroding of the binary 
foam regional image to obtain the center coordinates of each 
blob in the subset of blobs includes: (i) shrinking the sizes 
of the blobs in the subset of blobs; (ii) determining whether 
the size of a respective shrunken blob in the subset of blobs 
is smaller than the minimum blob size; (iii) recording a 
position of the respective shrunken blob as its center coor- 
dinates, if it is determined that the size of the respective 
shrunken blob in the subset of blobs is smaller than a 
minimum blob size; and (iv) repeating steps (i)-(iii) until 
none of the shrunken blobs in the subset of blobs has the size 
exceeding the minimum size. 


[0104] In some embodiments, the eroding of the binary 
foam regional image to obtain the center coordinates of each 
blob in the subset of blobs is performed using a 3x3 kernel 
or a 5x5 kernel. 


[0105] In some embodiments, the extracting of the one or 
more properties of bubbles in the foam further includes 
using a distance transformation to locate a plurality of local 
maxima, and designating the plurality of local maxima as the 
center coordinates of the plurality of blobs. 


[0106] In some embodiments, a center of each respective 
blob in all or a subset of the plurality of blobs is represented 
by a circle having a radius up to 3 pixels in radius, up to 5 
pixels in radius, or up to 8 pixels in radius. 


[0107] In some embodiments, the extracting of the one or 
more properties of bubbles in the foam further includes 
determining a peripheral boundary of each blob in the 
plurality of blobs or in the subset of the plurality of blobs, 
and generating a blob segmentation image in accordance 
with the determined peripheral boundary of each blob in the 
plurality of blobs or in the subset of the plurality of blobs. 
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[0108] In some embodiments, the determining of the 
peripheral boundary of each blob in the plurality of blobs or 
in the subset of the plurality of blobs includes: (1) calculating 
a distance of each pixel in the binary foam regional image 
to its nearest pixel that has a second pixel value, thereby 
producing a distance transformed image; (ii) using the 
obtained center coordinates of each blob in the plurality of 
blobs or in the subset of the plurality of blobs as a starting 
point to watershed the distance transformed image, thereby 
producing a plurality of watershed regions, where each 
watershed region in the plurality of watershed regions has a 
boundary; (iii) assigning the boundaries of the plurality of 
watershed regions as ridges of the plurality of watershed 
regions; and (iv) determining the peripheral boundary of 
each blob in the plurality of blobs or in the subset of the 
plurality of blobs in accordance with the ridges of the 
plurality of watershed regions. 

[0109] In some embodiments, the extracting of the one or 
more properties of bubbles in the foam further includes: (i) 
determining whether two adjacent blobs in the blob seg- 
mentation image are overlapped; (ii) merging the two adja- 
cent blobs into a combined blob, if it is determined that the 
two adjacent blobs in the blob segmentation image are 
overlapped; and (iii) optionally or additionally, repeating (i) 
and (ii), thereby producing a modified blob segmentation 
image. 

[0110] In some embodiments, the two adjacent blobs in 
the blob segmentation image are determined to be over- 
lapped, if a criteria of d<min(r1, r2) is met, where r1 and r2 
stand for radii of minimum bound circles of the two adjacent 
blobs, and d stands for a distance between centers of the 
minimum bound circles of the two adjacent blobs. 

[0111] In some embodiments, the merging of the two 
adjacent blobs into the combined blob is conducted by 
dilating each of the two adjacent blobs. 

[0112] In some embodiments, where for each respective 
blob in all or a subset of the blob segmentation image or in 
all or a subset of the modified blob segmentation image, the 
extracting of the one or more properties of the bubbles in the 
foam further includes: calculating one or more of the fol- 
lowing: an area A surrounded by the peripheral boundary of 
the respective blob; an equivalent diameter of the respective 
blob using a formula of sqrt (4xA/); a perimeter C of the 
peripheral boundary of the respective blob; a circularity of 
the respective blob using a formula of 4xmxA/C’; a solidity 
of the respective blob using a formula of A/HA, where HA 
stands for a convex hull area; a first aspect ratio of the 
respective blob using a formula of min(al, bl)/max(al, b1), 
where al and b1 stand for width and height of a bounding 
rectangle, respectively; a second aspect ratio of the respec- 
tive blob using a formula of min(a2, b2)/max(a2, b2), where 
a2 and b2 stand for width and height of a minimum 
bounding rectangle, respectively; a third aspect ratio of the 
respective blob using a formula of min(a3, b3)/max(a3, b3), 
where a3 and b3 stand for lengths of two axes of a fitted 
ellipse, respectively; a first extent of the respective blob 
using a formula of A/BRA, where BRA stands for an area of 
a bounding rectangle; a second extent of the respective blob 
using a formula of A/mBRA, where mBRA stands for an 
area of a minimum bounding rectangle; a third extent of the 
respective blob using a formula of A/mBCA, where mBCA 
stands for an area of a minimum bounding circle; and a 
fourth extent of the respective blob using a formula of A/EA, 
where EA stands for an area of a fitted ellipse. 


US 2022/0237763 Al 


[0113] In some embodiments, the at least one program 
further includes instructions for clustering the blobs in the 
blob segmentation image or in the modified blob segmen- 
tation image into two or more clusters. 

[0114] In some embodiments, the blobs are clustered in 
accordance with one or more properties selected from the 
circularity, solidity, first aspect ratio, second aspect ratio, 
third aspect ratio, first extent, second extent, third extent and 
fourth extent of each blob in the blob segmentation image or 
in the modified blob segmentation image. 

[0115] In some embodiments, a principle component 
analysis is performed to select the one or more properties 
from the circularity, solidity, first aspect ratio, second aspect 
ratio, third aspect ratio, first extent, second extent, third 
extent and fourth extent of each blob in the blob segmen- 
tation image or in the modified blob segmentation image. 
[0116] Insome embodiments, the clustering of the blobs is 
performed using a K-means clustering algorithm to mini- 
mize a within-cluster sum of squares, where the K-means 
clustering algorithm: 


sk 
TERES Y r-l 


i= x65; 


[0117] where, 
[0118] each x, in (x,, X5,...,x,,) is a blob, 
[0119] k is the number of clusters, 
[0120] each S={S,, S,..., S} is a set of blobs 


clustered into each cluster set, and 
[0121] each u, in (u,, us, ... , u,) is a centroid of a 
corresponding, cluster. 

[0122] In some embodiments, the method further includes 
classifying the blobs in the blob segmentation image, the 
blobs in the modified blob segmentation image, or the blobs 
in a first cluster that has a larger or a largest number of blobs 
among the two or more clusters, into bubble blobs and 
non-bubble blobs, by one or more of the following: classi- 
fying the blobs manually, and classifying the blobs using a 
bubble model. The method also includes generating a final 
set of blobs including each blob of the subset blobs in the 
blob segmentation image, the subset blobs in the modified 
blob segmentation image, or the subset blobs in a first cluster 
that has a larger or a largest number of blobs among the two 
or more clusters classified as a bubble blobs. 
[0123] In some embodiments, the method further includes 
selecting a first cluster that has a larger or a largest number 
of blobs from the two or more clusters and designating the 
blobs in the first cluster as a final set of blobs representative 
of the bubbles in the foam. The method also includes 
optionally or additionally, discarding remaining clusters in 
the two or more clusters. 
[0124] In some embodiments, the method further includes 
selecting a first cluster that has a larger or a largest number 
of blobs from the two or more clusters and comparing the 
blobs in the first cluster with the bubbles in the foam to 
identify one or more bubble blobs, and/or one or more 
non-bubble blobs. Each bubble blob in the one or more 
bubble blobs corresponds to a bubble in the foam, and each 
non-bubble blob in the one or more non-bubble blobs has no 
corresponding bubble in the foam. The method also includes 
constructing a training set including (1) the identified one or 
more bubble blobs, (ii) the identified one or more non- 
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bubble blobs, and/or (iii) one or more blobs in a second 
cluster in the two or more clusters as non-bubble blobs; and 
deriving, using the training set, a bubble model to classify 
blobs in accordance with the one or more extracted proper- 
ties of bubbles. 


[0125] In some embodiments, the method also includes 
updating the training set and/or refining the bubble model. 


[0126] In some embodiments, the method further includes 
one or more of the following: labeling the blobs in the blob 
segmentation image, the blobs in the modified blob segmen- 
tation image, or the blobs in a first cluster that has a larger 
or a largest number of blobs among the two or more clusters; 
drawing contours of the blobs in the blob segmentation 
image, the blobs in the modified blob segmentation image, 
or the blobs in a first cluster that has a larger or a largest 
number of blobs among the two or more clusters; and 
generating one or more data files. Each data file in the one 
or more data files includes one or more of the following: the 
extracted one or more characteristics of the foam in the 
foaming chamber of each respective foaming unit in all or a 
subset of the first foaming units; the final set of blobs; 
images with labeled blobs and/or drawn contours; and the 
first plurality of frames and/or the second plurality of 
frames. At least one frame of the first plurality of frames or 
the second plurality of frames has labeled blobs and/or 
drawn contours. 


[0127] In accordance with some embodiments, a foam 
generation system for high throughput foam analysis 
includes a plurality of foaming units, each foaming unit in 
the plurality of foaming units. Each foaming unit in the 
plurality of foaming units includes a foaming chamber 
configured to independently accommodate a respective solu- 
tion in a plurality of solutions, and a gas induction mecha- 
nism configured to introduce a gas into the respective 
solution in the foaming chamber as part of a foaming process 
that generates a foam in the foaming chamber. 


[0128] In some embodiments, the foam generation system 
for high throughput foam analysis includes a plurality of 
foaming units. Each foaming unit in the plurality of foaming 
unit includes a foaming chamber configured to indepen- 
dently accommodate a respective solution in a plurality of 
solutions. Each solution in each foaming unit in the plurality 
of foaming units undergoes an independent foaming pro- 
cess, thereby generating a respective foam in the foaming 
chamber of each foaming unit in the plurality of foaming 
units. 


[0129] In some embodiments, the foaming chamber of 
each respective foaming unit in all or a subset of the plurality 
of foaming units is characterized by a substantially rectan- 
gular cross section. 


[0130] In some embodiments, each respective foaming 
unit in all or a subset of the first plurality of foaming units 
includes a porous member that separates the foaming cham- 
ber of the respective foaming unit into a first portion and a 
second portion. The respective solution of the respective 
foaming unit is received in the second portion of the foaming 
chamber, and the gas induction mechanism of the respective 
foaming unit includes a vacuum source in fluid communi- 
cation with the second portion of the foaming chamber to 
pull the gas from the first portion to the second portion, 
thereby introducing the gas into the respective solution and 
generating the foam in the foaming chamber of the respec- 
tive foaming unit. 
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[0131] In some embodiments, the gas induction mecha- 
nism of each respective foaming unit in all or a subset of the 
first plurality of foaming units includes a porous sparger 
disposed in the foaming chamber of the respective foaming 
unit. The porous sparger is in fluid communication with a 
gas supply to introduce the gas into the respective solution 
of the respective foaming unit, thereby generating the foam 
in the foaming chamber of the respective foaming unit. 
[0132] In some embodiments, the porous member is a frit, 
and the frit has a pore size range between 10 um and 20 um, 
between 20 um and 30 um, or between 30 um and 40 um. In 
some embodiments, the frit has an average pore size that is 
between 10 um and 20 um, between 20 um and 30 um, or 
between 30 um and 40 um. 

[0133] In some embodiments, each respective porous 
sparger (i) has an active porous length and a pore size range 
between 2 um and 5 um, between 5 um and 10 um, between 
10 um and 15 um, or between 15 um and 20 um. The sparger 
is configured such that the active porous length of the 
respective sparger is submerged in the corresponding solu- 
tion before generating the foam. 

[0134] In some embodiments, the foaming chamber of 
each respective foaming unit in all or a subset of the first 
plurality of foaming units has of foaming units has linear 
dimensions between 25 mm and 100 mm, between 100 mm 
and 400 mm, or between 400 mm and 900 mm. 

[0135] In accordance with some embodiments, an analysis 
system for high throughput foam analysis includes at least 
one processor, and a nontransitory memory addressable by 
the at least one processor and storing at least one program 
for execution by the at least one processor. The at least one 
program including instructions for performing any of the 
methods described herein. 

[0136] In some embodiments, the program is stored in 
nontransitory memory addressable by at least one processor, 
and the program is executed by the at least one processor. 
The program includes instructions for performing any of the 
methods described herein. 


BRIEF DESCRIPTION OF THE DRAWINGS 


[0137] FIG. 1 is a schematic illustration of a system for 
high throughput foam analysis in accordance with some 
embodiments. 

[0138] FIG. 2 is a schematic illustration of a system for 
high throughput foam analysis in accordance with some 
embodiments. 

[0139] FIG. 3A is a schematic cross-sectional illustration 
of a vacuum foaming chamber in accordance with some 
embodiments. 

[0140] FIG. 3B is a schematic cross-sectional illustration 
of a sparger foaming chamber in accordance with some 
embodiments. 

[0141] FIG. 4 provides a flowchart for high throughput 
foam analysis of test entities in accordance with some 
embodiments. 

[0142] FIG. 5 provides a flowchart for a method of pre- 
paring a plurality of solutions and recording images of a 
foaming process in accordance with some embodiments. 
[0143] FIG. 6 provides a flowchart for a method to pro- 
duce a plurality of segmented images in accordance with 
some embodiments. 

[0144] FIG. 7A-FIG. 7G provide flowcharts for methods 
of extracting one or more dimensions of a foam and extract- 
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ing one or more properties of bubbles in a foam in accor- 
dance with some embodiments. 

[0145] FIG. 8 provides a flowchart for high throughput 
foam analysis of test entities in accordance with some 
embodiments. 

[0146] FIG. 9A provides a flowchart for constructing a 
training set and building a model for foam analysis in 
accordance with some embodiments. 

[0147] FIG. 9B-FIG. 9D provide flowcharts for generating 
final lists and data files from the analyzed data in accordance 
with some embodiments. 

[0148] FIG. 10A-FIG. 10L provide exemplary images of 
image processing performed in accordance of the methods 
disclosed herein in accordance with some embodiments. 
[0149] Like reference numerals refer to corresponding 
parts throughout the several views of the drawings. In the 
figures, optional steps or elements are denoted in dashed line 
boxes. 


DETAILED DESCRIPTION 


[0150] Systems and methods are provided for high 
throughput foam analysis. The systems and methods dis- 
closed herein provide for non-invasive, reproducible and 
precise manners for analyzing a variety of foam samples. In 
some embodiments, the high throughput systems and meth- 
ods disclosed herein are applied for surveying a vast space 
of possible entities from plants, and for identifying desirable 
entities from such sources for food applications. 

[0151] Reference will now be made in detail to embodi- 
ments, examples of which are illustrated in the accompany- 
ing drawings. In the following detailed description, numer- 
ous specific details are set forth in order to provide a 
thorough understanding of the present disclosure. However, 
it will be apparent to one of ordinary skill in the art that the 
present disclosure may be practiced without these specific 
details. In other instances, well-known methods, procedures, 
components, and networks have not been described in detail 
so as not to unnecessarily obscure aspects of the embodi- 
ments. 

[0152] It will also be understood that, although the terms 
“first”, “second”, etc. may be used herein to describe various 
elements, these elements should not be limited by these 
terms. These terms are only used to distinguish one element 
from another. For example, a “first subject” could be termed 
a “second subject”, and, similarly, a “second subject” could 
be termed a “first subject” without departing from the scope 
of the present disclosure. The first subject and the second 
subject are both subjects, but they are not the same subject. 
[0153] The terminology used in the present disclosure is 
for the purpose of describing particular embodiments only 
and is not intended to be limiting of the invention. As used 
in the description of the invention and the appended claims, 
the singular forms “a”, “an” and “the” are intended to 
include the plural forms as well, unless the context clearly 
indicates otherwise. It will also be understood that the term 
“and/or” as used herein refers to and encompasses any and 
all possible combinations of one or more of the associated 
listed items. It will be further understood that the terms 
“comprises” and/or “comprising,” when used in this speci- 
fication, specify the presence of stated features, integers, 
steps, operations, elements, and/or components, but do not 
preclude the presence or addition of one or more other 
features, integers, steps, operations, elements, components, 
and/or groups thereof. 
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[0154] As used herein, the term “if” may be construed to 
mean “when” or “upon” or “in response to determining” or 
“in response to detecting,” depending on the context. Simi- 
larly, the phrase “if it is determined” or “if [a stated 
condition or event] is detected” may be construed to mean 
“upon determining” or “in response to determining” or 
“upon detecting [the stated condition or event]” or “in 
response to detecting [the stated condition or event],” 
depending on the context. 


System 


[0155] A detailed description of systems for high through- 
put foam analysis of samples in accordance with the present 
disclosure is described in conjunction with FIGS. 1 through 
3. 

[0156] FIG. 1 is a schematic illustration of system 100 for 
high throughput foam analysis in accordance with some 
embodiments. System 100 includes foam generation system 
101, illumination source 104, detection system 105 and 
analysis system 108. Throughout the present disclosure, 
these components of system 100 will be referenced as 
separate devices solely for purposes of clarity. That is, the 
disclosed functionality of foam generation system 101, 
illumination source 104, detection system 105 and analysis 
system 108 are contained in separate devices as illustrated in 
FIG. 1. However, it will be appreciated that, in fact, in some 
embodiments, the disclosed functionality of foam generation 
system 101, illumination source 104, detection system 105 
and analysis system 108 are contained in a single device. 
Likewise, in some embodiments, some of the components of 
system 100 are contained in a single device, whereas some 
components are separated from the single device. For 
example, in some embodiments, foam generation system 
101, illumination source 104 and detection system 105 are 
contained in one device, and analysis system 108 is con- 
tained in another device. 

[0157] Foam generation system 101 includes one or more 
foaming units 112. In FIG. 1, only one foaming unit 112 is 
shown. In some embodiments, foam generation system 101 
includes a plurality of foaming units 112 (e.g., the number 
of foaming units is between 1 and k, where k is a positive 
integer of 2 or greater). In some embodiments, all or a subset 
a plurality of foaming units 112 are monolithically made of 
one unit. As used herein, a subset of a plurality of foaming 
units includes any number of foaming units between one and 
k-1. Foaming unit 112 includes one or more foaming 
chambers (e.g., foaming chambers 102-1, 102-2, ..., 102-7, 
where n is a positive integer of 2 or greater). In some 
embodiments, foaming units 112 are in an integrated block 
(e.g., a block containing two or more foaming chambers 
102-1, 102-2, . . . , 102-7). Each foaming chamber is 
configured to accommodate a solution for analysis of the 
solution’s foaming properties. Each foaming chamber of 
foaming chambers 102-1, 102-2, . . . , 102-7 is configured to 
independently accommodate a respective solution in a plu- 
rality of solutions. 

[0158] Foaming unit 112 also includes gas induction 
mechanism 113, which is configured to introduce a gas into 
foaming chambers 102-1, 102-2, .. . , 102-7. Gas induction 
mechanism 113 introduces a gas to the solution as part of a 
foaming process to generate a foam in foaming chambers 
102-1, 102-2, . . . , 102-. Each solution in respective 
foaming chambers 102 undergoes an independent foaming 
process, thereby generating a respective foam in the respec- 
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tive foaming chambers. In some embodiments, foam gen- 
eration system 101 further includes one or more sample 
racks to hold the one or more foaming units 112. For 
example, foam generation system 101 includes two foaming 
units 112, and two sample racks to hold each of the foaming 
units 112. In another example, foam generation system 101 
includes four foaming units 112, and two sample racks so 
that each sample rack holds two foaming units 112. 

[0159] Illumination source 104 provides illumination to 
foaming chambers 102-1, 102-2, . . . , 102-n of foaming unit 
112. In some embodiments, illumination source 112 includes 
one or more light-emitting diode (LED) panels (e.g., one or 
more Thin LED Backlights “Green”, item number MB-TBL 
4x5 by Metaphase Lighting Technologies.). The one or more 
LED panels are configured to emit light of a particular color 
(e.g., green, red, blue or white light). In some embodiments, 
illumination source 104 is configured to emit a green light 
with a wavelength of approximately 530 nm. 

[0160] In some embodiments, foaming chambers 102-1, 
102-2, . . . , 102-7 of foaming unit 112 are arranged in a line 
parallel to illumination source 104. In some embodiments, 
foaming chambers 102-1, 102-2, . . . , 102-n of foaming unit 
112 are arranged equidistant to, or somewhat equidistant to 
illumination source 104. Illumination source 104 is posi- 
tioned in system 100 so that illumination source 104 emits 
light toward detection system 105 via foam generation 
system 101, i.e. illumination source 104 and detection 
system 105 are on opposite sides of foam generation system 
101. Foam generation system 101 including foaming unit 
112 is disposed between illumination source 104 and detec- 
tion system 105. System 100 can also have alternative 
configurations for illuminating foaming chambers 102-1, 
102-2, . . . , 102-n by illumination source 104. In some 
embodiments, illumination source 104 is disposed on the 
right or the left side of foam generation system 101, and/or 
illumination source 104 is disposed above or below foam 
generation system 101. In some embodiments, illumination 
source 104 is disposed on the same side of foam generation 
system 101 as detection system 105. 

[0161] Detection system 105 includes camera 106. In 
some embodiments, camera 106 is a still camera, or a video 
camera (e.g., High Resolution Gig E Vision Camera, part 
number GT2750 by Allied Vision Technologies). Camera 
106 is configured to temporally record the foaming process 
in foaming chambers 102-1, 102-2, . . . , 102-” of foaming 
unit 112. In some embodiments, detection system 105 fur- 
ther includes telecentric lens 110 (e.g., Large Format Tele- 
centric Lens 0.104x Mag, part number TC2MHR120-C by 
Opto Engineering). Telecentric lens 110 is disposed between 
foaming unit 112 and camera 106. In some embodiments, 
telecentric lens 110 is optically coupled with camera 106. In 
some embodiments, camera 106 includes a built-in telecen- 
tric lens (e.g., telecentric lens 110). 


[0162] Telecentric lens 110 produces an orthogonal pro- 
jection of foaming unit 112 to camera 106, thereby reducing 
distortion and improving resolution of each respective frame 
in the first plurality of frames. Telecentric lens refers to a 
compound lens with at least one pupil set at a large enough 
distance from an optical surface to be comparable to an 
effect of having the at least one pupil set at infinity. An 
entrance pupil at “infinity” causes principal rays to be 
parallel to the optical axis in object space. Object-space 
telecentric lenses provide an orthogonal projection of an 
object. Object-space telecentric lenses have a constant, 
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non-angular field of view, and provide a constant magnifi- 
cation regardless of the distance between the object and the 
lens. Such property is beneficial when recording frames of 
foam for analysis, as the constant magnification provides the 
same magnification for bubbles of the foam regardless of 
their distance from the lens and therefore leads to more 
accurate size analysis. The constant magnification also 
reduces distortion and improves resolution of images. Fur- 
thermore, the blurring of an image due to movement of an 
object in and out of focus is symmetrical, as telecentric lens 
does not have angular component to the field of view. 
Therefore, an accurate analysis of an image can be made 
even when the object is not at the best focus, as long as the 
image has a high enough contrast for an algorithm to 
recognize features of the image. 

[0163] Analysis system 108 is in electronic communica- 
tion with detection system 105. Analysis system 108 
includes at least one processor 115 and nontransitory 
memory 114, which is addressable. Memory 114 stores at 
least one program for execution by processor 115. The at 
least one program includes instructions for performing any 
one of the methods described herein. 

[0164] In some embodiments, a program is disclosed. The 
program is stored in nontransitory memory 114 addressable 
by at least one processor. The program is executed by the at 
least one processor 115. The program includes instructions 
for performing any one of the methods described herein. 
[0165] System 100 performs high throughput foam analy- 
sis. System 100 facilitates non-invasive and fast detection of 
foaming in a large quantity of solutions by recording a 
plurality of frames. The imaging by detection system 105, 
including camera 106 and telecentric lens 110, provides high 
resolution frames and/or videos that enable extraction of 
foam characteristics by image processing. The methods of 
extracting foaming characteristics (e.g., a height of the foam, 
bubble sizes, a distribution of bubble sizes, and bubble 
shapes), are described below with respect to FIGS. 4-9. 
[0166] FIG. 2 is a schematic illustration of system 200 for 
high throughput foam analysis in accordance with some 
embodiments. System 200 corresponds to system 100 
described above with respect to FIG. 1, except that in system 
200, foam generation system 101 has a plurality of foaming 
units, including foaming units 112-1, . . . , 112-4, where k is 
equal to 2 or greater. Foaming units 112-1, ... , 112-k 
correspond to foaming unit 112 described above with respect 
to FIG. 1. Each foaming unit includes a plurality of foaming 
chambers, such as foaming chambers 102-1-1, . . . , 102-1-p 
of foaming unit 112-1 and foaming chambers 102-A-1,... 
, 102-k-g of foaming unit 112-k, where p, q=2. System 200 
also includes a plurality of detection systems, including 
detection systems 105-1, ..., 105-4. Detection system 105-1 
includes camera 106-1 and telecentric lens 110-1. Detection 
system 105-k includes camera 106-4 and telecentric lens 
110-k. Detection systems 105-1, . . . , 105-4 correspond to 
detection system 105 described above with respect to FIG. 
1. In some embodiments, each detection system of detection 
systems 105-1, . . . , 105-4 captures frames of corresponding 
individual foaming units 112-1, ... , 112-4. In some 
embodiments, a detection system of detection systems 105- 


1, . . . , 105-k captures frames of two or more foaming units 
112-1,..., 112-4 
[0167] In some embodiments, detection systems 105-1, . . 


. , 105-k are configured to capture one or more frames (e.g., 
a video) concurrently. For example, detection system 105-1 
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captures a first frame of foaming unit 112-1, and detection 
system 105-4 captures a second frame of foaming unit 112-4 
concurrently. In some embodiments, detection systems 105- 
1,..., 105-4 are configured to capture frames sequentially. 
For example, detection system 105-1 captures a first frame 
of foaming unit 112-1, and detection system 105-4 captures 
a second frame of foaming unit 112-k after the first frame has 
been captured. In some embodiments, a portion of detection 
systems 105-1, .. . , 105-4 captures frames concurrently 
while another portion of detection systems 105-1, . . . , 105-4 
does not capture frames at that time. In some embodiments, 
illumination source 104 illuminates all foaming chambers of 
foaming units 112-1, . . . , 112- concurrently. 


[0168] FIG. 3A is a schematic cross-sectional illustration 
of a vacuum foaming chamber 300 in accordance with some 
embodiments. Vacuum foaming chamber 300 corresponds to 
foaming chambers 102-1, 102-2, . . . , 102-7 described above 
with respect to FIG. 1. Vacuum foaming chamber 300 
includes enclosure 314 (e.g., a cuvette) and porous member 
308, which separates vacuum foaming chamber 300 into 
first portion 310 and second portion 304. In some embodi- 
ments, solution 306, which is a solution to be analyzed for 
its foaming properties and includes an entity, is received in 
second portion 304 of vacuum foaming chamber 300. In 
some embodiments, porous member 308 is a frit (e.g., 
vacuum foaming chamber 300 is a fritted column provided 
by Ace Glass, Inc.) with a pore size range between 10 um 
and 20 um, between 20 um and 30 wm, or between 30 um 
and 40 um. In some embodiments, the frit has an average 
pore size that is between 10 um and 20 um, between 20 um 
and 30 um, or between 30 um and 40 um. Foaming chamber 
300 is attached to vacuum source 213, which is included in 
(or alternatively is coupled with) gas induction mechanism 
113 described above with respect to FIG. 1. Vacuum source 
302 is in fluid communication with second portion 304 of 
vacuum foaming chamber 300, and is configured to pull gas 
from first portion 310 through porous member 308 to second 
portion 304, thereby introducing the gas into solution 306 
and generating foam in foaming chamber 300. In some 
embodiments, the introduction of the gas is enabled by 
creating a pressure difference across porous member 308. 
For example, a volume of gas is introduced to first portion 
310, or first portion 310 is exposed to air (e.g., by tubing or 
through an opening) so that first portion 310 is at ambient 
pressure. In some embodiments, first portion 310 is con- 
nected to a gas supply 312 for introducing volume of gas to 
first portion 310. 


[0169] The pressure difference is what matters either with 
the vacuum or the sparging such that there is flow of the air. 


[0170] FIG. 3B is a schematic cross-sectional illustration 
of sparging foaming chamber 320 in accordance with some 
embodiments. Sparging foaming chamber 320 corresponds 
to foaming chambers 102-1, 102-2, ... , 102-7 and 102-1-1 
described above with respect to FIG. 1. Sparging foaming 
chamber 320 includes enclosure 324 (e.g., a cuvette) and 
porous sparger 328 disposed in solution 306 in foaming 
chamber 320 (e.g., sparging foaming chamber 320 is a 
sintered sparger provided by Mott Corporation). Porous 
sparger 328 is in fluid communication with gas supply 322, 
and is configured to introduce gas into solution 306 of 
foaming chamber 320, thereby generating a foam in foaming 
chamber 320. Porous sparger 328 has an active porous 
length and a pore size range between 2 um and 5 um, 
between 5 um and 10 um, between 10 um and 15 wm, or 
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between 15 um and 20 um. In some embodiments, porous 
sparger 328 is configured such that the active porous length 
of the respective sparger is submerged in the corresponding 
solution before generating the foam. 

[0171] Vacuum foaming chamber 300 and sparging foam- 
ing chamber 320 are characterized by a substantially rect- 
angular cross-section. The linear dimensions of vacuum 
foaming chamber 300 and sparging foaming chamber 320 
range between 25 mm and 100 mm, between 100 mm and 
400 mm, or between 400 mm and 900 mm. In some 
embodiments, all foaming chambers 102-1, 102-2, ..., 
102-n of foaming unit 112 are characterized by a substan- 
tially rectangular cross-section. In some embodiments, a 
subset of foaming chambers 102-1, 102-2, ... , 102-n is 
characterized by a substantially rectangular cross-section 
(e.g., a subset including 1, 2,3, ...,n—1 foaming chambers). 
In some embodiments, foaming chamber 300 is character- 
ized by substantially round, elliptical, triangular, or other 
polygonal shape. In some embodiments, foaming chamber 
300 is characterized by a closed form shape. 

[0172] In some embodiments, all foaming chambers 102- 
1, 102-2, .. . , 102-n of foaming unit 112 are vacuum 
foaming chambers 300. In some embodiments, all foaming 
chambers 102-1, 102-2, . . . , 102-7 are sparging foaming 
chambers 320. In some embodiments, a first subset (e.g., 1, 
2,3,...,n-1 foaming chambers) includes vacuum foaming 
chambers 300 and a second subset (e.g., 1, 2, 3, ...,n-l 
foaming chambers) includes sparging foaming chambers 
320. 

[0173] In some embodiments, foaming chambers foaming 
chambers 102-1, 102-2, .. . , 102-7 described above with 
respect to FIG. 1 are configured to generate foam by other 
means known in the art. In some embodiments, foaming 
chambers 102-1, 102-2, . . . , 102-n are configured to be 
coupled with means for other gas induction mechanisms 
such as beating and/or shaking. 


High Throughput Foam Analysis 


[0174] Now that details of systems 100 and 200 for high 
throughput foam analysis of test entity have been disclosed, 
details regarding a flowchart processes and features of the 
system, in accordance with an embodiment of the present 
disclosure, are disclosed with a reference to FIG. 4. FIG. 4 
provides a flowchart for high throughput foam analysis of 
test entities in accordance with some embodiments. In some 
embodiments, such processes and features of the system are 
carried out by systems 100 and 200 as described with respect 
to FIGS. 1 and 2. 

[0175] Block 402. With reference to block 402 of FIG. 4, 
a first respective frame in the first plurality of frames is 
obtained by using system 100. The first respective frame is 
obtained by system 100 (or alternatively by system 200 of 
FIG. 2), as described above with respect to FIG. 1, which 
includes foam generation system 101, illumination source 
104, detection system 105 and analysis system 108. Analysis 
system 108 is in communication with detection system 105. 
Analysis system 108 includes at least one processor 115 and 
memory 114, which is addressable processor 115. Memory 
stores at least one program for execution by processor 115. 
Prior to obtaining the first respective frame, a foaming 
process is carried out, which will be described in detail 
below with respect to FIG. 5. 

[0176] Block 404. With reference to block 404 of FIG. 4, 
the first respective frame is segmented into a first plurality 


Jul. 28, 2022 


of segmented images. Each respective segmented image in 
the first plurality of segmented images is representative of a 
corresponding foaming chamber (e.g., foaming chamber 
102-1), together with the respective solution 306 and/or the 
foam in the corresponding foaming chamber of foaming unit 
112 in the first plurality of foaming units. The method of 
segmenting will be described in detail below with respect to 
FIG. 6. 


[0177] Block 406. With reference to block 406 of FIG. 4, 
from each segmented image in the first plurality of seg- 
mented images, one or more characteristics of the foam 
generated in the corresponding foaming chamber of each 
foaming unit in the first plurality of foaming units at the 
corresponding discrete time point are extracted, thereby 
facilitating high throughput foam analysis of the first plu- 
rality of solutions. The extracting of one or more character- 
istics include extracting one or more dimensions (e.g., 
height, width, depth) of the foam (block 406-1) and/or 
extracting one or more properties of bubbles in the foam 
(block 406-2). The extracted one or more characteristics of 
the foam includes one or more of the following: a height of 
the foam, bubble sizes, a distribution of bubble sizes, bubble 
shapes, bubble center coordinates, a bubble area, equivalent 
diameters of bubbles, perimeters of bubbles, a bubble cir- 
cularity, a bubble solidity, a first bubble aspect ratio, a 
second bubble aspect ratio, a third bubble aspect ratio, a first 
bubble extent, a second bubble extent, a third bubble extent 
and a fourth bubble extent. The method of extracting the one 
or more properties of bubbles includes image pre-processing 
(block 406-2-1), determining center coordinates of bubbles 
in the foam (block 406-2-2), segmenting bubbles in the foam 
(block 406-2-3), calculating one or more properties of 
bubbles in the foam (block 406-2-4) and post-processing 
(block 406-2-5). The method of extracting foaming charac- 
teristics is described in detail herein below with respect to 
FIGS. 7A-7G. 


[0178] Block 408. With reference to block 408 of FIG. 4, 
in some embodiments the method of high throughput foam 
analysis includes constructing a training set and/or building 
a bubble. A training set including a plurality of reference 
entities is trained using feature measurement data measured 
from the reference entities of the training set. This training 
set is limited in size and thus a number of foaming analyzes 
can be run on each reference entity in the training set in order 
to obtain values for a number of foaming properties of the 
reference entities of the training set. The measured values 
provide a basis for determining whether the particular ref- 
erence entity of the training set has the target foaming 
properties in some embodiments. The trained model can be 
used to rapidly test for the presence, absence and/or extent 
to which a test entity has the target foaming properties. That 
is, a test entity can be rapidly screened for the presence, 
absence and/or the extent to which it possesses the target 
foaming property. The method of constructing a training set 
or building a bubble model is described in detail herein 
below with respect to FIG. 9A. 


[0179] Block 410. With reference to block 410 of FIG. 4, 
in some embodiments the method of high throughput foam 
analysis includes generating a final list of bubbles and/or one 
or more data files. The methods of generating a final list of 
bubbles and/or one or more data files is described in detail 
herein below with respect to FIG. 9B-9C. FIGS. 10A-10L 
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provide exemplary images of image processing performed in 
accordance of the methods disclosed herein in accordance 
with some embodiments. 


Solution Preparation and Foaming Process 


[0180] FIG. 5 provides a flowchart for a method of pre- 
paring a plurality of solutions and recording images of a 
foaming process in accordance with some embodiments. 
[0181] Block 502. With reference to block 502 of FIG. 5, 
a first plurality of solutions is prepared. Typical measure- 
ment includes a plurality of solutions, each contained in a 
respective foaming chamber (e.g., foaming chambers 102-1, 
102-2, . . . , 102-n described with respect to FIG. 1). In 
typical embodiments, the solution (e.g., solution 306) con- 
tains a test entity. The test entity includes one or more 
foaming agents. As used herein, the term foaming agent 
refers to any material that facilitates formation of foam (e.g., 
a surfactant, or a protein). In some embodiments, the one or 
more foaming agents are amphipathic. 

[0182] In some embodiments, the test entity includes a 
protein, a fragment thereof, or a mixture of the protein with 
one or more other proteins. However, the present disclosure 
is not so limited, and in some embodiments the test entity 
alternatively comprises one or more different organic mol- 
ecules derived from living organisms such as protein (e.g., 
unmodified protein, sulfated, acylated or glycosylated pro- 
tein, non-ribosomal peptide), amino acids, one or more 
different oils (e.g., triglyceride, sterols and other neutral 
lipids), one or more different polar lipids (e.g., phospholip- 
ids, glycolipids, sphingolipids), one or more different car- 
bohydrates (e.g., polysaccharide, oligosaccharide, disaccha- 
ride, monosaccharide, etc.), one or more different sugar 
alcohols, one or more different phenols, one or more differ- 
ent polyphenols, one or more different nucleic acids, one or 
more different polynucleic acids, one or more different 
polyketides, one or more different xenobiotic compounds, 
combinations and covalently-bound combinations thereof 
(e.g., glycosidic protein or protein-bound lipid), and/or 
mixtures thereof (e.g., an oil and a phospholipid, etc.). In 
some embodiments, the test entity comprises two or more 
different organic molecules derived from living organisms 
such as protein (e.g., unmodified protein, sulfated, acylated 
or glycosylated protein, non-ribosomal peptide), two or 
more different amino acids, two or more different oils (e.g., 
triglyceride, sterols and other neutral lipids), two or more 
different polar lipids (e.g., phospholipids, glycolipids, sphin- 
golipids), two or more different carbohydrates (e.g., poly- 
saccharide, oligosaccharide, disaccharide, monosaccharide), 
two or more different sugar alcohols, two or more different 
phenols, two or more different polyphenols, two or more 
different nucleic acids, two or more different polynucleic 
acids, two or more different polyketides, two or more 
different xenobiotic compounds, two or more different com- 
binations and covalently-bound combinations thereof (e.g., 
glycosidic protein or protein-bound lipid), and/or two or 
more different mixtures thereof (e.g., an oil and a phospho- 
lipid, etc.). 

[0183] In some embodiments, the preparing a solution of 
the first plurality of solutions includes mixing of a test entity 
with one or more additives (e.g., water, salts, buffers and/or 
other suitable additives). In some embodiments, the prepar- 
ing includes adjusting and/or controlling parameters of the 
solution (e.g., temperature, pH, concentration, volume, etc.). 
The concentration of a test entity in a solution ranges 
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between 1% and 9%, or between 1% and 15%. Solution 306 
has a volume ranging between 1 ml and 2.5 ml, between 2.5 
ml and 10 ml, or between 10 ml and 20 ml. In some 
embodiments, each solution 306 in foaming chambers 102- 
1, 102-2, . . . , 102-7 has volume ranging between 1 ml and 
2.5 ml, between 2.5 ml and 10 ml, or between 10 ml and 20 
ml. In some embodiments, a subset of solutions 306 in 
foaming chambers 102-1, 102-2, . . . , 102-7 has volume 
ranging between 1 ml and 2.5 ml, between 2.5 ml and 10 ml, 
or between 10 ml and 20 ml (e.g., a subset including 1, 2, 3, 
..., D-1 foaming chambers). 


[0184] Block 504. With reference to block 404 of FIG. 5, 
the first plurality of solutions (e.g., solution 306) is intro- 
duced into foaming chambers 102-1, 102-2, . . . , 102-n of 
foaming unit 112 described with respect to FIG. 1. In the first 
plurality of solutions, at least two solutions are different 
from each other. In some embodiments, the at least two 
solutions are different in terms of a test entity included. For 
example, solution A contains protein P1 and solution B 
contains protein P2. As another example, solution A contains 
protein P1 and solution C contains a mixture of protein P1 
and P2. In some embodiments, the at least two solutions are 
different in terms of concentration (e.g., two solutions con- 
taining protein P1 with two different concentrations). In 
some embodiments, the at least two solutions are different in 
terms of their volume (e.g., two solutions containing protein 
P1 with two different volumes). In some embodiments, the 
at least two solutions are different in terms of other param- 
eters (e.g., pH, volume, temperature, types of additives, etc.) 


[0185] Block 506. With reference to block 506 of FIG. 5, 
a gas is introduced into a corresponding solution 306 con- 
tained in a foaming chamber (e.g., foaming chamber 102-1) 
of each respective foaming unit 112 in a first plurality of 
foaming units. The gas is introduced such that the corre- 
sponding solution 306 undergoes a foaming process, thereby 
generating a foam in the foaming chamber 102-1 of each 
respective foaming unit 112 in the first plurality of foaming 
units. The gas is introduced by gas induction mechanism 
113, which is configured to introduce a gas into foaming 
chambers 102-1, 102-2, . . . , 102-n. In some embodiments, 
the introducing the gas into a corresponding solution con- 
tained in a foaming chamber is done for a period of time 
(e.g., up to 1 min, 5 min, 10 min, 15 min, etc.). 

[0186] Mechanisms for introducing the gas are described 
with respect to FIGS. 3A and 3B, illustrating vacuum 
foaming chamber 300 and sparging foaming chamber 320, 
respectively. Vacuum foaming chamber 300 and sparging 
foaming chamber 320 are configured to introduce a gas into 
solution 306 so that the gas introduced is approximately 1 
times, 1.5 times, 2 times, 2.5 times, or 3 times that of the 
volume of solution in the foaming chamber of the respective 
foaming unit. In some embodiments, the gas introduced to 
each solution 306 in foaming chambers 102-1, 102-2, ..., 
102-n is approximately 1 times, 1.5 times, 2 times, 2.5 times, 
or 3 times that of the volume of the respective solution. In 
some embodiments, the gas introduced to a subset of solu- 
tions 306 in foaming chambers 102-1, 102-2, . . . , 102-7 is 
approximately 1 times, 1.5 times, 2 times, 2.5 times, or 3 
times that of the volume of the respective solution. As used 
herein, a subset of foaming chambers includes 1, 2, 3, ... 
, or n-1 foaming chambers. The gas is introduced into 
solution 306 at a flow rate lower than 200 ml/sec, lower than 
150 ml/sec, lower than 100 ml/sec, or lower than 50 ml/sec. 
In some embodiments, the gas is introduced to each solution 
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306 in foaming chambers 102-1, 102-2,..., 102—at a flow 
rate lower than 200 ml/sec, lower than 150 ml/sec, lower 
than 100 ml/sec, or lower than 50 ml/sec. In some embodi- 
ments, the gas is introduced to a subset of solutions 306 in 
foaming chambers 102-1, 102-2, . . . , 102-n at a flow rate 
lower than 200 ml/sec, lower than 150 ml/sec, lower than 
100 ml/sec, or lower than 50 ml/sec. In some embodiments, 
vacuum foaming chamber 300 and sparging foaming cham- 
ber 320 additionally include a meter to control a flow rate of 
the gas or a total amount of the gas introduced into the 
respective solution. In some embodiments, each foaming 
chamber 102-1, 102-2, . . . , 102-7 includes such a meter. In 
some embodiments, a subset of foaming chambers 102-1, 
102-2, . . . , 102-n includes such meters. 


[0187] In some embodiments, the gas introduced into 
solution 306 is air, nitrogen, carbon dioxide, noble gas or 
any other inert gas suitable for analyzing foaming properties 
of solution 306, or any mixture of gases thereof. In some 
embodiments, the same gas is introduced to all foaming 


chambers 102-1, 102-2, . . . , 102-n. In some embodiments, 
different gases are introduced to subsets of foaming cham- 
bers 102-1, 102-2, . . . , 102-n. For example, nitrogen is 


introduced to a first subset of foaming chambers, and air is 
introduced to a second subset of foaming chambers, where 
the foaming chambers of the second subset are different 
from the foaming chambers of the first subset. 


[0188] In some embodiments, the method of introducing 
the gas, including a type of the gas, a flow rate, amount of 
gas, etc., is the same for all solutions at respective foaming 
units 112-1, . . . , 112-4, as described above with respect to 
FIG. 2. In some embodiments, the gas introduced is the same 
for a first subset of foaming units (e.g., 1, 2, 3,..., or k-1 
foaming units), and the gas introduced is different for a 
second subset of foaming units (e.g., 1, 2, 3,..., or k-1 
foaming units). For example, the gas introduced to solutions 
of foaming units 112-1,..., 112-3 has one set of parameters 
(the gas type, gas flow rate, amount of gas, etc.) and, the gas 
introduced to solutions of foaming units 112-4, . . . , 112-k 
has second set of parameters (the gas type, gas flow rate, 
amount of gas, etc.). 


[0189] Block 508. With reference to block 508 of FIG. 5, 
a plurality of frames is produced by recording the foaming 
process in the foaming chamber of each respective foaming 
unit 112 in the first plurality of foaming units. The recording 
is performed by detection system 105, which includes cam- 
era 106 and telecentric lens 110. The recording includes 
producing a first plurality of frames, where each respective 
frame in the first plurality of frames is representative of the 
foaming process in each foaming chamber of foaming 
chambers 102-1, 102-2, . . . , 102-7 of foaming unit 112 at 
a corresponding discrete time point in a plurality of discrete 
time points. The first plurality of frames includes two or 
more frames (e.g., 2, 5, 10, 25, 50, 100, etc.). The time 
interval between two adjacent time points is predetermined 
(e.g., the time interval between two adjacent time points is 
5 seconds, 6 seconds, 7 seconds, 8 seconds, 9 seconds, 10 
seconds, 12 seconds, 15 seconds, or 20 seconds). For 
example, a first plurality of frames includes a set of frames 
representative of the foaming process recorded every 10 
seconds, for a period of time (e.g., 1, 2, 5, 10, 20 min, etc.). 
In some embodiments, the first plurality of frames is a first 
video. In some embodiments, the first video has a duration 
that is up to 5 minutes, 10 minutes, 15 minutes, or 20 
minutes, or longer. 
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[0190] During the recording, illumination source 104 illu- 
minates foaming chambers 102-1, 102-2, . . . , 102-n of 
foaming unit 112. In some embodiments, illumination 
source 106 emits emit a green light with a wavelength of 
approximately 530 nm. 

[0191] A representative example of a first respective frame 
is illustrated in FIG. 10A. FIG. 10A illustrates a frame of 
three foaming chambers (e.g., foaming chambers 102-1, 
102-2, 102-3) recorded by detection system 105. Each 
foaming chamber contains a respective solution and has 
gone through an individual foaming, as described above. 
The respective foams of each solution contain a plurality of 
bubbles (e.g., bubbles 1001). 


Segmenting Frames 


[0192] FIG. 6 provides a flowchart for a method to pro- 
duce a plurality of segmented images in accordance with 
some embodiments. 

[0193] Block 602. With reference to block 602 of FIG. 6, 
the segmenting of the first respective frame into the first 
segmented images includes creating a binary image from the 
first respective frame. In some embodiments, the creating of 
binary image (i.e. a black and white image) includes con- 
verting the respective first frame into a grayscale image 
(block 602-1). In some embodiments, the creating of binary 
image further includes using a threshold to binarize the 
grayscale image (block 602-2). In some embodiments, the 
image is taken as a black and white image and so it is not 
necessary to form a grayscale image from the original 
image. FIG. 10B illustrates a binary image of the first 
respective frame of FIG. 10A binarized using a threshold 
close to 0 (black). In some embodiments, subsequent to the 
creating of the binary image and prior to the selecting of the 
plurality of contours, noises are removed from the binary 
image (block 604). In some embodiments, the noise removal 
is performed by Gaussian blurring, median blurring, bilat- 
eral filtering, box filtering, averaging or any combination 
thereof. FIG. 10C illustrates the binary image of FIG. 10B 
after noise removal. 

[0194] Block 606. With reference to block 606 of FIG. 6, 
a plurality of contours is selected from the binary image, 
each contour in the plurality of contours corresponding to an 
outline of the foaming chamber of the foaming unit corre- 
sponding to the first frame. In FIG. 10C, contours corre- 
sponding to the outlines of the three foaming chambers are 
illustrated. 

[0195] Block 608. With reference to block 608 of FIG. 6, 
each respective frame is partitioned in accordance with the 
plurality of contours, thereby producing the plurality of 
segmented images. FIG. 10D illustrates a segmented image, 
which is partitioned from the first respective frame of FIG. 
10C. The segmented image of FIG. 10D corresponds to 
foaming chamber 1002 of FIG. 10A, and is partitioned in 
accordance with the contours corresponding to the outlines 
of the foaming chamber 1002. 

[0196] Block 610. With reference to block 610 of FIG. 6, 
each respective segmented image in all or a subset of the 
plurality of segmented images is cropped along a width 
direction (a first direction) of the respective segmented 
image from a first side and a second side of the respective 
segmented image. The cropping reduces an impact of a first 
side wall and a second side wall of the corresponding 
chamber on subsequent image analysis. In some embodi- 
ments, the cropping is up to 5%, 10%, 15%, 20%, 25%, or 
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30% (e.g., 25%). For example, FIG. 10D is cropped so as to 
exclude the side walls of the corresponding chamber. 


Extracting Foaming Characteristics 


[0197] FIGS. 7A-7G provide flowcharts for methods of 
extracting one or more dimensions of a foam and extracting 
one or more properties of bubbles in a foam in accordance 
with some embodiments. 

[0198] FIG. 7A illustrates a flowchart for a method to 
extract a dimension (e.g., height, or other form of linear 
measurement) of the foam for the one or each segmented 
image in the plurality of segmented images. Each respective 
segmented image in all or a subset of the plurality of 
segmented images includes a plurality of first subregion 
types, each first subregion type in the plurality of first 
subregion types includes a plurality of contiguous pixels. In 
some embodiments, the first subregion type is a row, or a 
portion of a row (e.g., a portion of a row including at least 
10 pixels, at least 15 pixels, at least 20 pixels, or at least 25 
pixels). In some embodiments, the first subregion region is 
a combination of two or more contiguous rows or a com- 
bination of two or more portions of contiguous rows. In 
some embodiments, first subregion type is a column, or a 
portion of a column (e.g., a portion of a column including at 
least 10 pixels, at least 15 pixels, at least 20 pixels, or at least 
25 pixels). In some embodiments, the first subregion type is 
a combination of two or more contiguous columns or a 
combination of two or more portions of contiguous columns. 
In some embodiments, the first subregion type (e.g., a row 
or a column) is aligned parallel to a solution-foam boundary 
between a respective solution and foam in the foaming 
chamber. Each pixel in the plurality of pixels has a pixel 
value representative of a brightness of the pixel. In some 
embodiments, the pixel value of each pixel is stored as an 
8-bit integer having a value ranging from 0 to 255, where in 
0 represents black in the segmented image, and 255 repre- 
sents white in the segmented image, in grayscale frames. A 
pixel value variance of each first subregion type in the 
plurality of first subregion types is calculated (block 702). A 
determination is made whether the calculated pixel value 
variance of each first subregion type in the plurality of first 
subregion types and cutoff values is between a first cutoff 
value and a second cutoff value, or between the second and 
a third cutoff value (block 704). In some embodiments, the 
first cutoff value is up to 2 or up to 5, the second cutoff value 
is up to 30, or up to 50, and the third cutoff value is up to 
800, or up to 1000. In some embodiments, the first cutoff 
value is up to 0, the second cutoff value is up to 20 and the 
third cutoff value is up to 600. 

[0199] One or more boundaries are identified (block 706). 
A method for identifying the one or more boundaries 
includes identifying a solution-foam boundary between the 
respective solution and the foam in the corresponding foam- 
ing chamber at the corresponding discrete time point (block 
706-1). First subregion types with pixel value variances 
between the first cutoff value and the second cutoff value 
represent the solution, and first subregion types with the 
pixel value variances between the second cutoff value and 
the third cutoff value represent the foam. A foam-gas bound- 
ary between the gas and the foam in the corresponding 
foaming chamber at the corresponding discrete time point 
(block 706-2), and a solution-chamber boundary between 
the solution and the corresponding foaming chamber at the 
corresponding discrete time point is identified (block 706-3). 
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[0200] A height of the foam in the corresponding chamber 
at the corresponding discrete time point is determined by 
counting the number of first subregion types from the 
solution-foam boundary to a top of the segmented image 
(block 708). The height is determined from the solution- 
foam boundary to a top of the segmented image (block 
708-1) and/or from the solution-foam boundary to the foam- 
gas boundary (708-2). Here an assumption is made that the 
top of the segmented image corresponds to the top of the 
foam. 


[0201] Optionally, or additionally, a height of the solution 
in the corresponding chamber at the corresponding discrete 
time point is determined (block 710) by counting the number 
of first subregion types from a bottom of the segmented 
image to the solution-foam boundary (block 710-1) and/or 
from the solution-chamber boundary to the solution-foam 
boundary (block 710-2). Herein, an assumption is made that 
the bottom of the segmented image corresponds to the 
bottom of the solution. The one or more boundaries further 
include a foam-gas boundary between the gas and the foam 
in the corresponding foaming chamber at the corresponding 
discrete time point, and a solution-chamber boundary 
between the solution and the corresponding foaming cham- 
ber at the corresponding discrete time point. First subregion 
types with the pixel value variances less than the first cutoff 
value represent the gas. A first subregion type at the foam- 
gas boundary has the pixel value exceeding the third cutoff 
value. A first subregion type at the solution-chamber bound- 
ary has the pixel value exceeding the third cutoff value. The 
height of the foam in the corresponding chamber at the 
corresponding discrete time point is determined by counting 
the number of first subregion types from the solution-foam 
boundary to the foam-gas boundary. The height of the 
solution in the corresponding chamber at the corresponding 
discrete time point is determined by counting the number of 
first subregion types from the solution-chamber boundary to 
the solution-foam boundary. 


[0202] FIGS. 7B-7C illustrates flowcharts for alternative 
methods to extract a dimension (e.g., height) of the foam 
and/or solution for the one or each segmented image in the 
plurality of segmented images. Each respective segmented 
image in all or a subset of the plurality of segmented images 
includes a plurality of first subregion types, each first 
subregion type in the plurality of first subregion types 
includes a plurality of contiguous pixels, and each pixel in 
the plurality of pixels has a pixel value representative of a 
brightness of the pixel. Flowchart of FIG. 7B illustrates a 
method including determining an image gradient (i.e., 1st 
derivative) for the one or more corresponding grayscale 
images of the partially foamed solution (block 711), and 
determining the number of directional changes for each first 
subregion type and each second subregion type in the image 
gradient (block 712). The first subregion type is described 
above with respect to FIG. 7A. The second subregion type 
corresponds to the first subregion type except that the second 
subregion type is perpendicular to the first subregion type 
(e.g., columns and rows). In some embodiments, the first 
subregion is a row and the second subregion is a column. 
The first subregion types in the one or more corresponding 
binary images of the partially foamed solution are then 
classified as corresponding to a solution phase or a foam, 
thereby identifying the location of a solution phase and a 
foam phase of the first material contained within the first 
chamber (block 713). For example, the first subregion types 
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identified with a higher number of directional changes are 
classified to correspond a foam phase, whereas first subre- 
gion types identified with a lower number of directional 
changes are classified to correspond a solution phase. A 
height of the foam in the corresponding chamber at the 
corresponding discrete time point is determined by counting 
the number of first subregion types corresponding to the 
foam phase (block 714). Optionally and additionally, a 
height of the solution in the corresponding chamber at the 
corresponding discrete time point is determined by counting 
the number of first subregion types corresponding to the 
solution phase (715). Flowchart of FIG. 7C illustrates a 
method including calculating a pixel value variance of each 
first subregion type in the plurality of first subregion types 
(block 716). A graphic with the calculated pixel value 
variances as a function of the first subregion types of the 
segmented image is generated (block 717). A height of the 
foam and/or a height of the solution at the corresponding 
discrete time point is graphically determined using one or 
more of first, second and third cutoff values (block 718). 
FIG. 10E illustrates a graphic of the calculated pixel value 
variances as a function of the first subregion types of the 
segmented image illustrated in FIG. 10D. The height of the 
foam and the height of the solution can be graphically 
determined from FIG. 10D. For example, the height of the 
foam in FIG. 10E is from 0 to 200 first subregion types and 
the height of the solution is approximately 650 first subre- 
gion types (i.e. approximately from first subregion type 200 
to first subregion type 850). 


[0203] FIG. 7D illustrates a flowchart for a method of 
extracting one or more properties of bubbles in the foam. 
Pre-processing of segmented images includes cropping each 
segmented image in all or a subset of the plurality of 
segmented images along a height direction of the segmented 
image to remove pixels below the solution-foam boundary 
and/or above the foam-gas boundary, thereby producing a 
foam regional image (block 719). FIG. 10F illustrates a 
foam regional image produced by cropping the segmented 
image of FIG. 10D. The foam regional image of FIG. 10F 
includes a plurality of bubbles and/or clusters of two or more 
bubbles (e.g., items 1003-1 and 1003-2) The height direction 
herein corresponds to the height of the chamber. Then, if the 
regional image is not a grayscale image, the foam regional 
image is converted into a grayscale foam regional image 
(block 720). Optionally, or additionally, the pre-processing 
also includes removing noise from each foam regional 
image or from the grayscale foam regional image (block 
722). In some embodiments, the noise removal includes 
Gaussian blurring, median blurring, bilateral filtering, box 
filtering, any other noise removal technique known in the 
art, or any combination thereof. In some embodiments, the 
noise removal is performed by Gaussian blurring. In some 
embodiments, the Gaussian blurring is performed using a 
3x3 kernel, or a 5x5 kernel. The pre-processing of seg- 
mented images further includes creating a binary foam 
regional image from the foam regional image or from the 
grayscale foam regional image (block 724). The binary foam 
regional image includes a plurality of blobs, each blob in the 
plurality of blobs including one or more pixels, and each 
pixel in the one or more pixels of each blob has a first pixel 
value. In some embodiments, the binary foam regional 
image is created by Otsu’s method, an adaptive mean 
thresholding method, an adaptive Gaussian thresholding 
method, or a thresholding method with a manually set 
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threshold. FIG. 10G illustrates a binary foam regional image 
created from the foam regional image of FIG. 10F. The 
binary foam regional image includes a plurality of (white) 
blobs, each blob (e.g., blobs 1004-1 and 1004-2 of FIG. 10F) 
having a first pixel value (e.g., pixel value 1 for white). Each 
blob (e.g., blobs 1004-1 and 1004-2) is an area in the image 
defined by the method described in the flowchart of FIG. 7D. 
Each blob represents a feature in the image, where the 
feature can include a bubble, a cluster of two or more 
bubbles, or any other features. 

[0204] The method illustrated in FIG. 7D further includes 
obtaining center coordinates of each blob in the plurality of 
blobs or in a subset of the plurality of blobs (block 726). 
Detailed methods for obtaining center coordinates for each 
blob will be provided in flowcharts of FIGS. 7F-7G. 
[0205] With reference to block 728 of FIG. 7D, the 
segmenting of bubbles in the foam includes determining a 
peripheral boundary of each blob in the plurality of blobs or 
in the subset of the plurality of blobs. The method of 
segmenting the bubbles in the foam includes calculating a 
distance of each pixel in the binary foam regional image to 
its nearest pixel that has a second pixel value, thereby 
producing a distance transformed image (block 728-1). In 
the case of non-eroded image, the calculating a distance of 
each pixel is to its nearest black pixel. The obtained center 
coordinates of each blob in the plurality of blobs or in the 
subset of the plurality of blobs are used as a starting point to 
watershed the distance transformed image, thereby produc- 
ing a plurality of watershed regions (block 728-2). Each 
watershed region in the plurality of watershed regions has a 
boundary, and the boundaries of the plurality of watershed 
regions are assigned as ridges of the plurality of watershed 
regions (block 728-3). The peripheral boundary of each blob 
in the plurality of blobs or in the subset of the plurality of 
blob is determined in accordance with the ridges of the 
plurality of watershed regions (block 728-4). 

[0206] FIG. 7E illustrates a flowchart for a further method 
of extracting one or more properties of bubbles in the foam. 
[0207] Block 730. With reference to block 730 of FIG. 7E, 
the segmenting of bubbles in the foam further includes, in 
accordance with the determined peripheral boundary of each 
blob in the plurality of blobs or in the subset of the plurality 
of blobs, generating a blob segmentation image. In some 
embodiments, the blob segmentation image includes a 
physical image. In some embodiments, the blob segmenta- 
tion image includes a set of pixel data. 

[0208] Block 732. With reference to block 732 of FIG. 7E, 
the segmenting of bubbles in the foam further includes 
merging overlapping bubbles by producing a modified blob 
segmentation image from the blob segmentation image 
(block 732). The method of merging overlapping bubbles 
includes determining whether two adjacent blobs in the blob 
segmentation image are overlapped (block 732-1). In some 
embodiments, the two adjacent blobs in the blob segmen- 
tation image are determined to be overlap if a criteria of 
d<r2) is met, where r, and r, stand for radii of minimum 
bound circles of the two adjacent blobs, and d stands for a 
distance between centers of the minimum bound circles of 
the two adjacent blobs. In accordance with determination 
that the two adjacent blobs in the blob segmentation image 
are overlap, the segmentation image is further post-pro- 
cessed. The post-processing includes merging the two adja- 
cent blobs into one blob (block 732-2). In some embodi- 
ments, the merging the two adjacent blobs into one blob is 
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conducted by dilating each of the two adjacent blobs. In 
some embodiments, optionally or additionally, the steps of 
block 732-1 and block 732-2 are repeated thereby producing 
a modified blob segmentation image. 

[0209] With reference to block 734 of FIG. 7E, calculating 
one or more properties of bubbles in the foam for one or each 
respective blob in the blob segmentation image or in the 
modified blob segmentation image includes calculating one 
or more of the following: 

[0210] (i) An area A surrounded by the peripheral 
boundary of the one or each respective blob; 

[0211] (i) An equivalent diameter of the one or each 
respective blob using a formula of sqrt (4xA/z); 

[0212] (iii) A perimeter C of the peripheral boundary of 
the one or each respective blob; 

[0213] (iv) A circularity of the one or each respective 
blob using a formula of 4xmxA/C?; 

[0214] (v)A solidity of the one or each respective blob 
using a formula of A/HA, where HA stands for a 
convex hull area (the term “hull convex,” also referred 
to as convex envelope, of a set X of points in the 
Euclidean plane or in an Euclidean space or, more 
generally, in an affine space over the reals), is defined 
as the smallest convex set that contains X; 

[0215] (vi) A first aspect ratio of the one or each 
respective blob using a formula of min(a,, b,)/max(a,, 
b,), wherein a, and b, stand for width and height of a 
bounding rectangle, respectively; 

[0216] (vii) A second aspect ratio of the one or each 
respective blob using a formula of min(a,, b,)/max(ap, 
b,), wherein a, and b, stand for width and height of a 
minimum bounding rectangle, respectively; 

[0217] (viii) A third aspect ratio of the one or each 
respective blob using a formula of min(a3, b3)/max(a;, 
b,), wherein a, and b, stand for lengths of two axes of 
a fitted ellipse, respectively; 

[0218] (ix) A first extent of the one or each respective 
blob using a formula of A/BRA, where mBRA stands 
for an area of a bounding rectangle; 

[0219] (x)A second extent of the one or each respective 
blob using a formula of A/mBRA, where mBRA stands 
for an area of a minimum bounding rectangle; 

[0220] (xi) A third extent of the one or each respective 
blob using a formula of A/mBCA, where mBCA stands 
for an area of a minimum bounding circle; and 

[0221] (xii) A fourth extent of the one or each respective 
blob using a formula of A/EA, wherein EA stands for 
an area of a fitted ellipse. 

[0222] FIGS. 7F-7G illustrate two methods for obtaining 
center coordinates of blobs in detail. In the first method, as 
illustrated in FIG. 7F, for each blob in the plurality of blobs 
(block 736), a determination of the center coordinates of 
each blob in the plurality of blobs includes determining 
whether a size of a respective blob in the plurality of blobs 
is smaller than a minimum blob size representative of a 
minimum bubble size (block 736-1). The minimum blob size 
is up to 8 pixels in radius, up to 10 pixels in radius, up to 15 
pixels in radius, up to 20 pixels in radius, up to 25 pixels in 
radius, up to 30 pixels in radius, up to 40 pixels in radius, up 
to 50 pixels in radius, or more. In some embodiments, the 
minimum blob size is up to 10 pixels in radius. In accor- 
dance with the determination that the respective blob is 
smaller than the minimum blob size, discarding the respec- 
tive blob (block 736-2). The steps of determining whether a 


Jul. 28, 2022 


size of a respective blob in the plurality of blobs is smaller 
than a minimum blob size representative of a minimum 
bubble size, and discarding the respective blob in accor- 
dance with a determination that its size is smaller than the 
minimum blob size are repeated for each blob in the plurality 
of blobs. Thereby a subset of blobs, where each blob in the 
subset of blobs has the size equal or larger than the minimum 
blob size, is produced (block 738). Each blob in the subset 
of blobs has the size equal to or larger than the minimum 
blob size. Then, the binary foam regional image is eroded to 
obtain center coordinates of each blob in the subset of blobs 
(block 740). The eroding includes (1) shrinking the sizes of 
the blobs in the subset of blobs (block 740-1); (2) determin- 
ing whether the size of a respective shrunken blob in the 
subset of blobs is smaller than the minimum blob size (block 
740-2); (3) recording a position of the respective shrunken 
blob as its center coordinates, if it is determined that the size 
of the respective shrunken blob in the subset of blobs is 
smaller than a minimum blob size (block 740-3); and 
repeating the shrinking, determining and the recording steps, 
until none of the shrunken blobs in the subset of blobs has 
the size exceeding the minimum size (block 740-4). In some 
embodiments, the eroding of the binary foam regional image 
to obtain the center coordinates of each blob in the subset of 
blobs is performed using a 3x3 kernel or a 5x5 kernel. 


[0223] FIG. 7G illustrates an alternative method for deter- 
mining the center coordinates bubbles in the foam. The 
method of FIG. 7G involves using a distance transformation 
to locate a plurality of local maxima (block 724) and 
designating the plurality of local maxima as the center 
coordinates of the plurality of blobs (block 726). 


[0224] After either of methods provided in FIG. 7F or 7G, 
a center of each respective blob in all or a subset of the 
plurality of blobs is represented by a circle having up to 3 
pixels in radius, up to 5 pixels in radius, or up to 8 pixels in 
radius. To avoid over-splitting bubbles, a larger circle can be 
used to include neighbor centers. In some embodiments, the 
circle has a radius of 5 pixels. 


[0225] FIGS. 10H-10K illustrate the image processing 
performed on a binary foam regional image according to 
process described above. FIG. 10H illustrates a binary foam 
regional image. The binary foam regional image has been 
produced by converting a respective foam regional image to 
grayscale and applying a Gaussian blur method to remove 
noise. The image is then thresholded into a binary image (a 
black and white image) by using Otsu’s method. FIG. 101 
illustrates an image including bubble centers produced from 
the binary foam regional image of FIG. 10H. The bubble 
centers are found by iteratively eroding the binary foam 
regional image so that each white blob is shrinking until 
disappeared. Each blob position was recorded while the 
radius of each bubble is smaller than 10 pixels, and before 
the bubble disappears. The minimum bubble size was set to 
10 pixels. Blobs smaller than 10 pixels prior to the eroding 
were discarded. The bubble centers were drawn as white 
dots of radius of 5 pixels so that blobs that were positioned 
close to each other got merged to avoid over-splitting. FIG. 
10J illustrates a distance transformed image. The distance 
transformed image is produced by calculating a distance of 
each pixel with a first pixel value (i.e. each white pixel) in 
the binary foam regional image to its nearest pixel that has 
a second pixel value (i.e. a black pixel). FIG. 10K illustrates 
a bubble segmented image produced by using the obtained 
center coordinates of each blob in the plurality of blobs or 
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in the subset of the plurality of blobs as a starting point to 
watershed the distance transformed image. The bubble seg- 
mented image contains a plurality of watershed regions, 
where each watershed region in the plurality of watershed 
regions has a boundary. 


Training Set 


[0226] In order to construct a training set, the methods for 
high throughput foam analysis described above are per- 
formed for a second plurality of solutions. Such method is 
illustrated in a flowchart in FIG. 8. The steps described in 
reference to FIG. 8 correspond to steps described with 
respect to FIG. 5, except that they are performed for a 
second plurality of solutions. The method of FIG. 8 is 
performed by system 100 or system 200, as described above 
with respect to FIGS. 1 and 2, respectively. First a second 
plurality of solutions is prepared (block 802). The second 
plurality of solutions is introduced into the foaming cham- 
bers (e.g., foaming chambers 102-k-1, 102-k-2, ..., 
102-k-qg) of the second plurality of foaming units (e.g., 
foaming unit 112-4) (block 704). A gas is introduced into a 
corresponding solution contained in a foaming chamber of 
each respective foaming unit in a second plurality of foam- 
ing units such that the corresponding solution undergoes a 
foaming process, thereby generating a foam in the foaming 
chamber of each respective foaming unit in the second 
plurality of foaming units (block 806). In some embodi- 
ments, the introducing of the gas into the corresponding 
solution contained in the foaming chamber of each respec- 
tive foaming unit in the first plurality of foaming units and 
the introducing of the gas into the corresponding solution 
contained in the foaming chamber of each respective foam- 
ing unit in the second plurality of foaming units are con- 
ducted simultaneously. In some embodiments, the gas is 
introduced sequentially. For example, the gas can be intro- 
duced simultaneously or sequentially to all solutions con- 


tained in foaming chambers 102-1-1, 102-1-2, . . . , 102-1-p 
and foaming chambers 102-A-1, 102-A-2, . . . , 102-k-q in 
FIG. 2). 

[0227] The foaming process in the foaming chamber of 


each respective foaming unit in the second plurality of 
foaming units is recorded to produce a second plurality of 
frames (block 808). Each respective frame in the second 
plurality of frames representative of the foaming process in 
the foaming chamber of each foaming unit in the second 
plurality of foaming units at a corresponding discrete time 
point in the plurality of discrete time points. In some 
embodiments, the recording of the foaming process in the 
foaming chamber of each respective foaming unit in the first 
plurality of foaming units and the recording of the foaming 
process in the foaming chamber of each respective foaming 
unit in the second plurality of foaming units are conducted 
simultaneously. In some embodiments, the recordings are 
conducted sequentially. For example, system 200 includes a 
plurality of detection systems 105-1, .. . , 105-4 which can 
record the foaming process in the respective foaming cham- 
bers simultaneously or sequentially. Each respective frame 
in the second plurality of frames is representative of the 
foaming process in the foaming chamber of each foaming 
unit in the second plurality of foaming units at a correspond- 
ing discrete time point in the plurality of discrete time 
points. 

[0228] A second respective frame in the second plurality 
of frames is obtained (block 810). The second respected 
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framed is segmented into a second plurality of segmented 
images (block 812). Each respective segmented image in the 
second plurality of segmented images is representative of a 
corresponding foaming chamber, together with the respec- 
tive solution and/or the foam in the corresponding foaming 
chamber of a respective foaming unit in the second plurality 
of foaming units at the corresponding discrete time point. 
From each segmented image in the second plurality of 
segmented images, one or more characteristics of the foam 
generated in the corresponding foaming chamber of each 
foaming unit in the second plurality of foaming units at the 
corresponding discrete time point are extracted, thereby 
facilitating high throughput foam analysis of the second 
plurality of solutions (block 814). 

[0229] In some embodiments, the method of high through- 
put foam analysis described with respect to FIG. 4, further 
includes performing the steps for a third plurality of solu- 
tions, a fourth plurality of solution, etc. In some embodi- 
ments, the method of high throughput foam analysis further 
includes obtaining a third respective frame in the plurality of 
frames and segmenting the third respective frame into a third 
plurality of segmented images. Each respective segmented 
image in the third plurality of segmented images is repre- 
sentative of a corresponding foaming chamber, together with 
the respective solution and/or the foam in the corresponding 
foaming chamber of a respective foaming unit in the first 
plurality of foaming units. The method also includes extract- 
ing, from each segmented image in the third plurality of 
segmented images, one or more characteristics of the foam 
generated in the corresponding foaming chamber of each 
foaming unit in the first plurality of foaming units, thereby 
facilitating high throughput foam analysis of the first plu- 
rality of solutions. 

[0230] Insome embodiments, the method of high through- 
put foam analysis further includes obtaining a fourth respec- 
tive frame in the plurality of frames and segmenting the 
fourth respective frame into a fourth plurality of segmented 
images. Each respective segmented image in the fourth 
plurality of segmented images is representative of a corre- 
sponding foaming chamber, together with the respective 
solution and/or the foam in the corresponding foaming 
chamber of a respective foaming unit in the first plurality of 
foaming units. The method also includes extracting, from 
each segmented image in the fourth plurality of segmented 
images, one or more characteristics of the foam generated in 
the corresponding foaming chamber of each foaming unit in 
the first plurality of foaming units, thereby facilitating high 
throughput foam analysis of the first plurality of solutions. 
[0231] FIG. 9A illustrates a method of constructing a 
training set in accordance with some embodiments. 

[0232] Block 902. With reference to block 902 of FIG. 9A, 
the constructing a training set includes clustering the blobs 
in the blob segmentation image or in the modified blob 
segmentation image into two or more clusters (block 902). 
The blobs are clustered in accordance with one or more 
properties selected from the circularity, solidity, first aspect 
ratio, second aspect ratio, third aspect ratio, first extent, 
second extent, third extent and fourth extent of each blob in 
the blob segmentation image or in the modified blob seg- 
mentation image. The selection of the one or more properties 
is performed by principle component analysis. In some 
embodiments, the clustering of the blobs is performed using 
a K-means clustering algorithm to minimize a within-cluster 
sum of squares by using the following formula: 
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i=l x65; 


[0233] where, 
[0234] each x, in (x,, X2, ..., X,,) is a blob, 
[0235] k is the number of clusters, 
[0236] each S={S,, Sa, ..., S,} is a set of blobs 


clustered into each cluster set, and 
[0237] each u, in (u,, u,, ... , U,) is a centroid of a 

corresponding cluster. 
[0238] With reference to block 904 of FIG. 9A, a first 
cluster that has a larger or a largest number of blobs from the 
two or more clusters is selected. The blobs in the first cluster 
with the bubbles in the foam are compared to identify one or 
more bubble blobs, and/or one or more non-bubble blobs 
(block 906). Each bubble blob in the one or more bubble 
blobs corresponds to a bubble in the form, and each non- 
bubble blob in the one or more non-bubble blobs has no 
corresponding bubble in the foam. A bubble model to 
classify blobs in accordance with the one or more extracted 
properties of bubbles is derived, using the training set (block 
708). The training set is updated and/or the bubble model is 
refined (block 910) in accordance with performing the 
method described herein in FIG. 9A. 


Generating a Final List of Bubbles 


[0239] Methods for generating a final list of bubbles are 
illustrated in FIGS. 9B-9D. 

[0240] With reference to FIG. 9B, a method for generating 
a final list of bubbles includes classifying the blobs in the 
blob segmentation image, the blobs in the modified blob 
segmentation image, or the blobs in a first cluster that has a 
larger or a largest number of blobs among the two or more 
clusters, into bubble blobs and non-bubble blobs (block 
912). The classifying the blobs is performed by one or more 
of the following: classifying the blobs manually (block 
912-1), and classifying the blobs using a bubble model 
(automatically) (block 912-2). In some embodiments, the 
classifying the blobs manually includes comparing the blobs 
in the blob segmentation image (e.g., blobs 1004-1 and 
1004-2 of FIG. 10G), the blobs in the modified blob seg- 
mentation image, or the blobs in a first cluster that has a 
larger or a largest number of blobs among the two or more 
clusters with bubbles and/or clusters of two or more bubbles 
(e.g., items 1003-1 and 1003-2 of FIG. 10F) visually, and, 
based on the visual comparison, determining whether a 
respective blob is a bubble or a non-bubble. A final set of 
blobs including each classified bubble blob is generated in 
accordance with classifying the blobs (block 914). 

[0241] With reference to FIG. 9C, an alternative method 
for generating a final list of bubbles includes clustering the 
blobs in the blob segmentation image or in the modified blob 
segmentation image into two or more clusters (block 916). 
A first cluster that has a larger or a largest number of blobs 
from the two or more cluster is selected (block 918). The 
blobs in the first cluster are designated as a final set of blobs 
reprehensive of the bubbles in the foam (block 920). Option- 
ally or additionally, the remaining clusters in the two or 
more clusters are discarded (block 922). 

[0242] With reference to FIG. 9D, in some embodiments 
the method of constructing a training set to classify blobs 
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includes one or more of steps illustrated in the flowchart. In 
some embodiments, the constructing a training set includes 
labeling the blobs in the blob segmentation image, the blobs 
in the modified blob segmentation image, or the blobs in a 
first cluster that has a larger or a largest number of blobs 
among the two or more clusters (block 924) and drawing 
contours of the blobs in the blob segmentation image, the 
blobs in the modified blob segmentation image, or the blobs 
in a first cluster that has a larger or a largest number of blobs 
among the two or more clusters (block 926). In some 
embodiments, the method of constructing a training set to 
classify blobs also includes generating one or more data files 
(block 928). Each data file in the one or more data files 
comprising one or more of the following: the extracted one 
or more characteristics of the foam in the foaming chamber 
of one or each respective foaming unit in the first and/second 
plurality of foaming units; the final set of blobs; images with 
labeled blobs and/or drawn contours; and the first and/or 
second set of frames. At least one frame of the first or second 
set of frames has labeled blobs and/or drawn contours. FIG. 
10L illustrates an image with labeled blobs, and drawn 
contours. In some embodiments, each blob is numbered. For 
instance, in FIG. 10L, blobs 1004-3 and 1004-4 are denoted. 


REFERENCES CITED AND ALTERNATIVE 
EMBODIMENTS 


[0243] All references cited herein are incorporated herein 
by reference in their entirety and for all purposes to the same 
extent as if each individual publication or patent or patent 
application was specifically and individually indicated to be 
incorporated by reference in its entirety for all purposes. 
[0244] The present invention can be implemented as a 
computer program product that comprises a computer pro- 
gram mechanism embedded in a nontransitory computer 
readable storage medium. For instance, the computer pro- 
gram product could contain the program modules shown in 
any combination of FIGS. 4-9. These program modules can 
be stored on a CD-ROM, DVD, magnetic disk storage 
product, USB key, or any other non-transitory computer 
readable data or program storage product. 
[0245] Many modifications and variations of this inven- 
tion can be made without departing from its spirit and scope, 
as will be apparent to those skilled in the art. The specific 
embodiments described herein are offered by way of 
example only. The embodiments were chosen and described 
in order to best explain the principles of the invention and its 
practical applications, to thereby enable others skilled in the 
art to best utilize the invention and various embodiments 
with various modifications as are suited to the particular use 
contemplated. The invention is to be limited only by the 
terms of the appended claims, along with the full scope of 
equivalents to which such claims are entitled. 
1-84. (canceled) 
85. A method for high throughput foam analysis, com- 
prising: 
obtaining a first respective frame from a first plurality of 
frames, wherein the first plurality of frames is produced 
by temporally recording a respective foaming process 
in each foaming chamber of each foaming unit in a first 
plurality of foaming units, each respective frame in the 
first plurality of frames representative of the foaming 
process in the foaming chamber of each foaming unit in 
the first plurality of foaming units at a corresponding 
discrete time point in a plurality of discrete time points; 
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segmenting the first respective frame into a first plurality 
of segmented images, each respective segmented image 
in the first plurality of segmented images representative 
of a corresponding foaming chamber, together with the 
respective solution and/or the foam in the correspond- 
ing foaming chamber of a respective foaming unit in 
the first plurality of foaming units at the corresponding 
discrete time point; and 

extracting, from each segmented image in the first plu- 

rality of segmented images, one or more characteristics 
of the foam generated in the corresponding foaming 
chamber of each foaming unit in the first plurality of 
foaming units at the corresponding discrete time point, 
thereby facilitating high throughput foam analysis of 
the first plurality of solutions. 

86. The method of claim 85, comprising: 

obtaining a second respective frame from a second plu- 

rality of frames, wherein the second plurality of frames 
is produced by temporally recording a respective foam- 
ing process in each foaming chamber of each foaming 
unit in a second plurality of foaming units, each respec- 
tive frame in the second plurality of frames represen- 
tative of the foaming process in the foaming chamber 
of each foaming unit in the second plurality of foaming 
units at a corresponding discrete time point in the 
plurality of discrete time points; 

segmenting the second respective frame into a second 

plurality of segmented images, each respective seg- 
mented image in the second plurality of segmented 
images representative of a corresponding foaming 
chamber, together with the respective solution and/or 
the foam in the corresponding foaming chamber of a 
respective foaming unit in the second plurality of 
foaming units at the corresponding discrete time point; 
and 

extracting, from each segmented image in the second 

plurality of segmented images, one or more character- 
istics of the foam generated in the corresponding foam- 
ing chamber of each foaming unit in the second plu- 
rality of foaming units at the corresponding discrete 
time point, thereby facilitating high throughput foam 
analysis of the second plurality of solutions. 

87. The method of claim 85, wherein the segmenting of 
the respective frame into a plurality of segmented images 
comprises: 

creating a binary image from the respective frame; 

selecting a plurality of contours from the binary image, 

each contour in the plurality of contours corresponding 
to an outline of the foaming chamber of a respective 
foaming unit in the first or second plurality of foaming 
units; and 

partitioning the respective frame in accordance with the 

plurality of contours, thereby producing the plurality of 
segmented images. 

88. The method of claim 87, wherein the creating of the 
binary image comprises: 

converting the respective frame into a grayscale image; 

and 

using a threshold to binarize the grayscale image, thereby 

creating the binary image. 

89. The method of claim 87, wherein the segmenting of 
the respective frame into the plurality of segmented images 
further comprises one or more of the following: 
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removing, subsequent to the creating of the binary image 
and prior to the selecting of the plurality of contours, 
noises from the binary image; and 

cropping each respective segmented image in all or a 
subset of the plurality of segmented images along a 
width direction of the respective segmented image from 
a first side and a second side of the respective seg- 
mented image to reduce impact of a first side wall and 
a second side wall of the corresponding chamber on 
subsequent image analysis, wherein the cropping is up 
to 5%, 10%, 15%, 20%, 25%, or 30%. 

90. The method of claim 87, wherein for each respective 
segmented image in all or a subset of the plurality of 
segmented images, the extracting of the one or more char- 
acteristics of the foam comprises one or more of the fol- 
lowing: 

extracting one or more dimensions of the foam; and 

extracting one or more properties of bubbles in the foam. 
91. The method of claim 90, wherein 
each respective segmented image in all or a subset of the 
plurality of segmented images comprises a plurality of 
first subregion types, each first subregion type in the 
plurality of first subregion types comprises a plurality 
of contiguous pixels, and each pixel in the plurality of 
pixels has a pixel value representative of a brightness of 
the pixel; and 
for the respective segmented image, the extracting of the 
one or more dimensions of the foam comprises: 
calculating a pixel value variance of each first subre- 
gion type in the plurality of first subregion types; 

determining whether the calculated pixel value vari- 
ance of each first subregion type in the plurality of 
first subregion types and cutoff values is between a 
first cutoff value and a second cutoff value, or 
between the second and a third cutoff value; 

identifying one or more boundaries, wherein the one or 
more boundaries comprises a solution-foam bound- 
ary between the respective solution and the foam in 
the corresponding foaming chamber at the corre- 
sponding discrete time point, wherein first subregion 
types with the pixel value variances between the first 
cutoff value and the second cutoff value represent the 
solution, and first subregion types with the pixel 
value variances between the second cutoff value and 
the third cutoff value represent the solution; 

determining a height of the foam in the corresponding 
chamber at the corresponding discrete time point by 
counting the number of first subregion types from the 
solution-foam boundary to a top of the segmented 
image; and 

optionally or additionally, determining a height of the 
solution in the corresponding chamber at the corre- 
sponding discrete time point by counting the number of 
first subregion types from a bottom of the segmented 
image to the solution-foam boundary. 

92. The method of claim 91, wherein the one or more 

boundaries further comprises: 

a foam-gas boundary between the gas and the foam in the 
corresponding foaming chamber at the corresponding 
discrete time point; and 

a solution-chamber boundary between the solution and 
the corresponding foaming chamber at the correspond- 
ing discrete time point, wherein: 
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first subregion types with the pixel value variances less 
than the first cutoff value represent the gas, 

a first subregion type at the foam-gas boundary has the 
pixel value exceeding the third cutoff value, 

a first subregion type at the solution-chamber boundary 
has the pixel value exceeding the third cutoff value, 

the height of the foam in the corresponding chamber at 
the corresponding discrete time point is determined 
by counting the number of first subregion types from 
the solution-foam boundary to the foam-gas bound- 
ary, and 

the height of the solution in the corresponding chamber 
at the corresponding discrete time point is deter- 
mined by counting the number of first subregion 
types from the solution-chamber boundary to the 
solution-foam boundary. 

93. The method of claim 90, wherein: 


each respective segmented image in all or a subset of the 
plurality of segmented images comprises a plurality of 
first subregion types, each first subregion type in the 
plurality of first subregion types comprises a plurality 
of contiguous pixels, and each pixel in the plurality of 
pixels has a pixel value representative of a brightness of 
the pixel; and 

for the respective segmented image, the extracting of the 

one or more dimensions of the foam comprises: 

calculating a pixel value variance of each first subre- 
gion type in the plurality of first subregion types; 

generating a graphic with the calculated pixel value 
variances as a function of the first subregion types of 
the segmented image; and 

graphically determining a height of the foam and/or a 
height of the solution at the corresponding discrete 
time point, using one or more of first, second and 
third cutoff values. 

94. The method of claim 91, wherein the first cutoff value 
is up to 2 or up to 5; the second cutoff value is up to 30, or 
up to 50, and the third cutoff value is up to 800, or up to 
1000. 


95. The method of claim 90, wherein 

each respective segmented image in all or a subset of the 
plurality of segmented images comprises a plurality of 
first subregion types, each first subregion type in the 
plurality of first subregion types comprises a plurality 
of contiguous pixels, and each pixel in the plurality of 
pixels has a pixel value representative of a brightness of 
the pixel; and 

for the respective segmented image in the plurality of 
segmented images, the extracting of the one or more 
dimensions of the foam comprises: 

determining an image gradient for the one or more 
corresponding grayscale images of the partially foamed 
liquid; 

determining the number of directional changes for each 
first subregion type and each second subregion type in 
the image gradient; 

classifying the first subregion types of pixels in the one or 
more corresponding binary images of the partially 
foamed liquid as corresponding to a solution phase or 
a foam, thereby identifying the location of a solution 
phase and a foam phase of the first material contained 
within the first chamber; 
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a height of the foam in the corresponding chamber at the 
corresponding discrete time point by counting the num- 
ber of first subregion types corresponding to the foam 
phase; and 

optionally or additionally, determining a height of the 
solution in the corresponding chamber at the corre- 
sponding discrete time point by counting the number of 
first subregion types corresponding to the solution 
phase. 

96. The method of claim 91, wherein the pixel value of 
each pixel is stored as an 8-bit integer having a value ranging 
from 0 to 255, where in 0 represents black in the segmented 
image, and 255 represents white in the segmented image. 

97. The method of claim 91, wherein for each respective 
segmented image in all or a subset of the plurality of 
segmented images, the extracting of the one or more prop- 
erties of bubbles in the foam comprises: 

cropping the respective segmented image along a height 
direction of the respective segmented image to remove 
pixels below the solution-foam boundary and/or above 
the foam-gas boundary, thereby producing a foam 
regional image. 

98. The method of claim 97, wherein the extracting of the 
one or more properties of bubbles in the foam further 
comprises: 

converting, if the foam regional image is not a grayscale 
image, the foam regional image into a grayscale foam 
regional image; 

optionally or additionally, removing a noise source from 
the foam regional image or from the grayscale foam 
regional image; and 

creating a binary foam regional image from the foam 
regional image or from the grayscale foam regional 
image, wherein the binary foam regional image com- 
prises a plurality of blobs, each blob in the plurality of 
blobs comprises one or more pixels, and each pixel in 
the one or more pixels of each blob has a first pixel 
value. 

99. The method of claim 98, wherein the noise source is 
removed by Gaussian blurring, median blurring, bilateral 
filtering, box filtering, or any combination thereof. 

100. The method of claim 99, wherein the Gaussian 
blurring is performed using a 3x3 kernel, or a 5x5 kernel. 

101. The method of claim 98, wherein the binary foam 
regional image is created by an Otsu’s method, an adaptive 
mean thresholding method, an adaptive Gaussian threshold- 
ing method, or a thresholding method with a manually set 
threshold. 

102. The method of claim 98, wherein the extracting of 
the one or more properties of bubbles in the foam further 
comprises: 

(i) determining whether a size of a respective blob in the 
plurality of blobs is smaller than a minimum blob size 
representative of a minimum bubble size; 

(ii) discarding the respective blob when it is determined 
that its size is smaller than the minimum blob size; 

(iii) repeating the determining (i) and discarding (ii) for 
each respective blob in the plurality of blobs, thereby 
producing a subset of blobs, wherein each respective 
blob in the subset of blobs has a size equal to or larger 
than the minimum blob size; and 

(iv) eroding the binary foam regional image to obtain 
center coordinates of each blob in the subset of blobs. 
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103. The method of claim 102, wherein the eroding of the 
binary foam regional image to obtain the center coordinates 
of each respective blob in the subset of blobs comprises: 

(1) shrinking a size of each respective blobs in the subset 
of blobs; 

(ii) determining whether a size of a respective shrunken 
blob in the subset of blobs is smaller than the minimum 
blob size; 

(iii) recording a position of the respective shrunken blob 
as its center coordinates, when it is determined that the 
size of the respective shrunken blob in the subset of 
blobs is smaller than a minimum blob size; and 

(iv) repeating the shrinking (i), determining (ii) and 
recording (iii) until each respective shrunken blob in 
the subset of blobs has a size that is less than the 
minimum size. 

104. The method of claim 102, wherein the eroding of the 
binary foam regional image to obtain the center coordinates 
of each blob in the subset of blobs is performed using a 3x3 
kernel or a 5x5 kernel. 

105. The method of claim 102, wherein the minimum blob 
size is up to 8 pixels in radius, up to 10 pixels in radius, or 
up to 15 pixels in radius. 

106. The method of claim 98, wherein the extracting of 
the one or more properties of bubbles in the foam further 
comprises: 

using a distance transformation to locate a plurality of 
local maxima; and 

designating the plurality of local maxima as the center 
coordinates of the plurality of blobs. 

107. The method of claim 98, wherein a center of each 
respective blob in all or a subset of the plurality of blobs is 
represented by a circle having a radius up to 3 pixels in 
radius, up to 5 pixels in radius, or up to 8 pixels in radius. 

108. The method of claim 102, wherein the extracting of 
the one or more properties of bubbles in the foam further 
comprises: 

determining a peripheral boundary of each respective blob 
in the plurality of blobs or in the subset of the plurality 
of blobs; and 

generating a blob segmentation image in accordance with 
the determined peripheral boundary of each respective 
blob in the plurality of blobs or in the subset of the 
plurality of blobs. 

109. The method of claim 108, wherein the determining 
of the peripheral boundary of each respective blob in the 
plurality of blobs or in the subset of the plurality of blobs 
comprises: 

(i) calculating a distance of each pixel in the binary foam 
regional image to its nearest pixel that has a second 
pixel value, thereby producing a distance transformed 
image; 

(ii) using the obtained center coordinates of each respec- 
tive blob in the plurality of blobs or in the subset of the 
plurality of blobs as a starting point to watershed the 
distance transformed image, thereby producing a plu- 
rality of watershed regions, wherein each watershed 
region in the plurality of watershed regions has a 
boundary; 

Gii) assigning the boundaries of the plurality of watershed 
regions as ridges of the plurality of watershed regions; 
and 

(iv) determining the peripheral boundary of each respec- 
tive blob in the plurality of blobs or in the subset of the 
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plurality of blobs in accordance with the ridges of the 
plurality of watershed regions. 

110. The method of claim 108, wherein the extracting of 
the one or more properties of bubbles in the foam further 
comprises: 

(i) determining whether two adjacent blobs in the blob 

segmentation image are overlapped; 

(ii) merging the two adjacent blobs into a one blob when 
it is determined that the two adjacent blobs in the blob 
segmentation image are overlapped; and 

(iii) optionally or additionally, repeating the determining 
(i) and merging (ii), thereby producing a modified blob 
segmentation image. 

111. The method of claim 110, wherein the two adjacent 
blobs in the blob segmentation image are deemed to be 
overlapped when a criteria of d<min(r,, ra) is satisfied, 
wherein r; and r, are respectively the radii of minimum 
bound circles of the two adjacent blobs, and d is a distance 
between centers of the minimum bound circles of the two 
adjacent blobs. 

112. The method of claim 110, wherein the merging of the 
two adjacent blobs into the combined blob is conducted by 
dilating each of the two adjacent blobs. 

113. The method of claim 108, wherein for each respec- 
tive blob in all or a subset of the blob segmentation image 
or in all ora subset of the modified blob segmentation image, 
the extracting of the one or more properties of bubbles in the 
foam further comprises: calculating one or more of the 
following: 

an area A surrounded by the peripheral boundary of the 
respective blob; 

an equivalent diameter of the respective blob using a 
formula of sqrt (4xA/z); 

a perimeter C of the peripheral boundary of the respective 
blob; 

a circularity of the respective blob using a formula of 
4xmxA/C?; 

a solidity of the respective blob using a formula of A/HA, 
wherein HA stands for a convex hull area; 

a first aspect ratio of the respective blob using a formula 
of min(a,, b,)/max(a,, b,), wherein a, and b, are 
respectively a width and a height of a bounding rect- 
angle; 

a second aspect ratio of the respective blob using a 
formula of min(a,, b,)/max(a,, b,), wherein a, and b, 
are respectively a width and a height of a minimum 
bounding rectangle; 

a third aspect ratio of the respective blob using a formula 
of min(a;, b;)/max(a3, bz), wherein a, and b, are 
respective lengths of two axes of a fitted ellipse; 

a first extent of the respective blob using a formula of 
A/BRA, wherein BRA stands for an area of a bounding 
rectangle; 

a second extent of the respective blob using a formula of 
A/mBRA, wherein mBRA stands for an area of a 
minimum bounding rectangle; 

a third extent of the respective blob using a formula of 
A/mBCA, wherein mBCA stands for an area of a 
minimum bounding circle; and 

a fourth extent of the respective blob using a formula of 
A/EA, wherein EA stands for an area of a fitted ellipse. 

114. The method of claim 113, wherein the at least one 
program further comprises instructions for: 
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clustering the blobs in the blob segmentation image or in 
the modified blob segmentation image into two or more 
clusters. 

115. The method of claim 114, wherein the blobs are 
clustered in accordance with one or more properties selected 
from the circularity, solidity, first aspect ratio, second aspect 
ratio, third aspect ratio, first extent, second extent, third 
extent and fourth extent of each blob in the blob segmen- 
tation image or in the modified blob segmentation image. 

116. The method of 115, wherein a principle component 
analysis is performed to select the one or more properties 
from the circularity, solidity, first aspect ratio, second aspect 
ratio, third aspect ratio, first extent, second extent, third 
extent and fourth extent of each blob in the blob segmen- 
tation image or in the modified blob segmentation image. 

117. The method of claim 114, wherein the clustering of 
the blobs is performed using a K-means clustering algorithm 
to minimize a within-cluster sum of squares, wherein the 
K-means clustering algorithm: 


k 
PN 


i=l xeS; 


wherein, 
each x; in (X,, X2, ... , X„) is a blob, 
k is the number of clusters, 
each S={S,, S3,..., S,} is a set of blobs clustered into 
each cluster set, and 
each u, in (Uj, Us, ..., U,) is a centroid of a 


corresponding cluster. 
118. The method of claim 113, further comprising: 
classifying the blobs in the blob segmentation image, the 
blobs in the modified blob segmentation image, or the 
blobs in a first cluster that has a larger or a largest 
number of blobs among the two or more clusters, into 
bubble blobs and non-bubble blobs, by one or more of 
the following: 
classifying the blobs manually, and 
classifying the blobs using a bubble model; and 
generating a final set of blobs comprising each blob of the 
subset blobs in the blob segmentation image, the subset 
blobs in the modified blob segmentation image, or the 
subset blobs in a first cluster that has a larger or a 
largest number of blobs among the two or more clusters 
classified as a bubble blobs. 
119. The method of claim 114, further comprising: 
selecting a first cluster that has a larger or a largest number 
of blobs in its respective subset of blobs from the two 
or more clusters; 
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designating the subset of blobs in the first cluster as a final 
set of blobs representative of the bubbles in the foam; 
and 
optionally or additionally, discarding remaining clusters 
in the two or more clusters. 
120. The method of claim 114, further comprising: 
selecting a first cluster that has a larger or a largest number 
of blobs in its respective subset of blubs from the two 
or more clusters; 
comparing the blobs in the subset of blobs of the first 
cluster with the bubbles in the foam to identify one or 
more bubble blobs, and/or one or more non-bubble 
blobs, wherein each bubble blob in the one or more 
bubble blobs corresponds to a bubble in the foam, and 
each non-bubble blob in the one or more non-bubble 
blobs has no corresponding bubble in the foam; 
constructing a training set comprising (i) the identified 
one or more bubble blobs, (ii) the identified one or 
more non-bubble blobs, and/or (iii) one or more blobs 
in a second cluster in the two or more clusters as 
non-bubble blobs; and 
deriving, using the training set, a bubble model to classify 
blobs in accordance with the one or more extracted 
properties of bubbles. 
121. The method of claim 120, further comprising: updat- 
ing the training set and/or refining the bubble model. 
122. The method of claim 91, further comprising one or 
more of the following: 
labeling the blobs in the blob segmentation image, the 
blobs in the modified blob segmentation image, or the 
blobs in a first cluster that has a larger or a largest 
number of blobs among the two or more clusters; 
drawing contours of the blobs in the blob segmentation 
image, the blobs in the modified blob segmentation 
image, or the blobs in a first cluster that has a larger or 
a largest number of blobs among the two or more 
clusters; and 
generating one or more data files, each data file in the one 
or more data files comprising one or more of the 
following: 
the extracted one or more characteristics of the foam in 
the foaming chamber of each respective foaming unit 
in all or a subset of the first foaming units; 
the final set of blobs; 
images with labeled blobs and/or drawn contours; and 
the first plurality of frames and/or the second plurality 
of frames, wherein at least one frame of the first 
plurality of frames or the second plurality of frames 
has labeled blobs and/or drawn contours. 
123-133. (canceled) 
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